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SUMMvARY AND IMPLICATIONS 



OBJECTIVBS ' ' . . „ ^ / 

The; objtH'tive of Lhi.s project i.s to faotlitiite tlie transfer and.utilizatiop of training 
teelyiolo^y by developing a model for evaluating training approaches or,inno\atioii.s in 
relation to the require^ment.s, resources, and constraints of specific training settings. ' 



APPROACH ' ' , ' : J ' , M • • 

^ , ' > . . ^ ' ). , ' • 

The approach taken m developifig the model foV matching training approaches with 
training settings was to construct ' tvvo parallel .sets of opea-endi'cf c^uestion^ -one set 
concerning the characteri.stics of the training' approach under con^deration, andi»,one set 
(i'Onceming the requirements, resources, and constraints irv the specific trauiing setting. 
When the;>e^ questions ha\e been answered, the information needed to euxluate how weJl 
^the training approach *'fits" the- training setting" is available and arrayed m a .conven- 
" lent format * . ^ , • ^ , - 

Fhe tb'jrm ^'training ap^proach*' ib intended as a neutral term to include any metho<^ 
technique, device, or systi»m considered for use in training. Exampleii range from simple 
audiovisual deviles intended to^.uttUlurt an ongoing program of training, to compr^^hensive 
.training systems t^he adoption ,ofwTiich would revamp hirge elements of the training 
organization- Son\e,. traTmng approaches may be truly inno\ations. ,Qthers^ may already 
'have beeh used in a. variety of other training settings.-^ 

, The^ term /'training setting" is intended ificlude the physical and personnel 
re.sources of the. training organization , 'the policies anii requirements of t}le personnel and^ 
tfiiining administrative .sy.^tems involved, the abilitie,s, previous experience, physical 
characteristics; and attitudes of the trainees; iuid the nature ot the train;ng contepH^s 
de^scrihed m t^aii^ing objectives. ^ * . , / 

' The moder was developed by first con.^idenng a number of Irainmg approaches a^d 
a.sking the question, *AVhtit features do the.se t^raining apprdaches have that would make a. 
difference in 'their suitability {Qt use in \ ariou.s* trair\ing setting.s?" From the an.swers to 
this question for a number of tr/\ining approaches, preliminary outline o^ characteristics 
was developed ahd applied to several training; approaches. ' , ' 

At this point attention wds shifted to ViiriQUS features known- to be involved in 
' military training .settirfgs,' apd tUe question was^ asked, '*Do these features^of trainings 
.settings makx'.^ differenc6 , the feasifiility or suitability of various alternative training 
•approaches for^se In these traimng iiettifigs?** If the answer appeared _to be **Ye.sr" these 
features of the trtiimng sc^ttings were incorporate^d- into , the outline of characteristics. 1'he 
outlme of ^haractferfstics was then recast into two parallel sets of questions, one for 
traifii^ng approaches and one for .training settings. /' ^ 

. ; *This preliminary' version <?f the model was then, taken to .th(^ field in extensive 
interviews and discussions with training* rpanagers and? curriculum designers at^several Air 
Force Technical '1/ainmg ('enters. > ^ ' . ^ \ 



RESULTS . ) 

Following' the .siiggtistions of thi^ trainms^ maniikortS and curriculum' "designers ihtor- 
vu;w«'d at ''the rechnii'-al 'Trainin;,' ("Vnttrs.THp'Triodel was, revised extensively U) plaee 



more emphasis on questions concerning costs of training and the*availability of resources 
m training settings, to'^^incorporate terminology jnore familiar to Air Force pt4sonnel, and 
to add numerous questions. * 

The revised model was then applied^to a training approach (peer instructionrwiT 
considerable success, and to a training setting (the Law Enforcement Specialist course at 
Lackland AFB) with somewhat less success, because jieeded information was not'available 
at a distance from the training setting. ^ ^ « 

^ ' ^ / ^ 

IMPLICATIONS - . ' 

The modePfor matching \traini/ig approaches with training settings h'as- aroused 
considerable interest. Suppdirt has beeh' forthcoming for continued work in applying the 
model to training approaches and^trainmg settings ia >an Air Force Technical Training 
Center. It is planned to actually develop a new course and implement *it as a part of' 
thiseffort. » . . » - 



PREFACE 



This report describes work performed by the Human Resources Research Organiza- 
tion during the first year under Research Project AFTEC^ Basic Researdi Relevant to 
LJ.S. Air Force technicial Training, for the Air Force Office of Scientific Research. The 
development. of a model ^or evaluating training approaches in relatipn to specific training 
settings is discussed in this report. Further refinement and evaluation of 'the model is 
uiider way. . i , ; . 

Jhe research is being conducted at HumRRO*s Eastern Division, Alexandria, 
Virginia. Dr. J.. Daniel Lyons is, Director of the Division, a^d. Dr. Edgar M. Haverland is 
principal investigator for the project. The researcl^was begun at Division No. 7 (Social 
•Science) before it became part of the Eastern Division; Dr. Robert G. Smith, Jr., was 
Director of Division No. 7, and was ^ member of the research ' teaiA that gathered 
information at Air. Force Technical Training Centers. Dr. Eugene A. Cogan contributed^ 
^'gxiidance and stimulating suggestions during the conceptualization and development of 
the model. * * , 

This project is being conducted for the Fdrce Office of Scientific Research 
(AFOSR) .under (^ontract F44620-74-C-0007. This report has been submitted to AFOSR 
as an IiiteTriftT&ientific Report. » 



„ . Meredith P. Crawford 
President 

Human Resources Research Organization 
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Chapter 1 
BACKGROUND 



INTRODUCTION 



• / Training in the U.S. Air Force is characterized by missive coverage of a wide, range 
of content, and by the necessity .for frequent revisiony or replacement of substantial V 
'^portions ot the vast array of graining materials, in ordyei^ to keep pace with djanging,/ 
> Requirements and progr^s. In one recent year, it was. ejjUmated that oJ the 300,000/ 
• is'^'-ho^ of different kinds of training being presented irf'^^^the Air Training Cofhmm^' 
^^'^'feetween 50,000 and 7&*,500 hours were being phased out,' to bfe replaced by neV training 
jpaterfal covering , different ^^ximent and betweeff 50,000 and 60,000 hours \sf^r^* being 
revised.* . ^ ^ \ hi 

Much of this training is quite exppsive, and some o^ it involves lai^e /numbers of 
students. In technical training alone, the Air Forc6 spends over half a bilficm doll^s and 
graduates more than 150,000 persons^ year froni five teclyiical schools jmd ni^tnei^^us 
on-the-job ,trainirtg courses (Carpenter, 1^72). Thus, improvements iinh-^^ff^^ off 
.training have the, potential for s4ving lai^e- amounts of money. - 

In a training sy^en^ in which mc^e than pne-third of the training is^bejng revised or' 
developed during any givenAear, #aiKl in which so much money is spent and so many 
- persons trained, the effeq|tiveness/of the ^ training develapm'ent process is crucial in 
determining the efficiency of thefsystem; 'As training is developed yOr revised, there is 
always the opi^jffunity %o choose .more effective training approaches. Xti developing 
, training 'for anj^^articular W there will always be a wide range of approaches from 
which to. choose, 6on>e genuinely new and innovative, aifil some, jwhile a&eady in use in 
other settings, new to the particular setting. Ef^tive use of trairi|ng tecJinology depends 
• X heavily on careful evaluation and wise choice of training approaches in* the training 
developmeni^rocess. 



./• 



/ 



OBJECTIVE 

. \rhe^bjec$ive of this project is to contribute to the* effective use of t/aining 
tecbnblogy^ throu^ the^development of a mpdel for evaluating training approafcbes or 
innovatJpns in relation to ^p^ific training settings. The applicability o^potentLfl useful* 
ness of the training approach^ or innovation in a particular, training settifeis ev^uated by 
systematically comparing the* charadtm&tics of the training approach or/inn9vation with 
the corresponding characteristics or reqiDtirements of the trainingjsetting. 
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DEFINITIONS 



.V 



The term "training^ approach" is intended to include any method/ technique, device, 
or system considered for use in training. Examples range from simple ajfdiavisual devices 
intended to support an ongoing program of training, to comprehensive training systems. 



'personal communicatioQ with Chester L. Bueker, 31 October 1973. 
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the adoption of^wlrich would reyamp large elements of the tr^inifig oig'anizatjon. Earlier' . ' ' , 
work in thj^ojeCt used the term "training innovation,** but '"training^approach** has 
^been. adop^.as a nfeutral term to signify any metl^6d, techniq/ie, device, or system being 
considered ior* adoption, in a traiiying setting, whether it is truly an innovation, qr has 
- already Jjeen used in a variety of other training settings. • . . ; 

"Training-setting** fs also intended to be a neutral term with wide applicability. For - . 
example, a particular training getting could be defined in relation to an entire course,- - * • 
lasting many weeks, to a major portion of -such a course, or to a spiall segment, of it,' •- 
dealing with a particular topic or skill and lasting for a few days or even hours. • ' ' " 

The term "ttaining siting**- is intended to include (a) the nature of the training ' 
fontent, as embodied in t^Te training objectives for the course ,or -portipn of the course; 
(b) the physical and pei^onnel^ resources of the training establishment-including the 
buildings or classroom oi other space available fftr th^ course or portion thereof, training 
or operational Aiuipmght, and instructional and supervisory personnel; (c) the policies 
4' : ^ and requirements of t^e per|jnnel and training adminisb'ative systems involved-as well fls . " 

training center or agency responsible; (d)the * 
abilities, previou§>e:^perience,.Rhysic-archaracteristics, and attitudes of the trainees. 

This model can be applied in several ways.- .It can be u§ed.wrhen the training setting * 
. is given and the -i)roblem is, to select training approaches, either for insertion into an 
ongoing traipmg/prograrp, or in developing a ijew coulrse'or program. It c^ Sso be used ' *' 
to analyze and/ciescribe^training apptoaches ifi terms that shoul^ be more relevant f6 the - 
^ concerns of tire trainirig .designer and develftper than arfe the research rep6rts and journal 
^ articles nonnfllly used" to disseminiate information about training methods and techniques. 

. Finally/ the model ,can be/tised to make an inventory of the charactefi'stics of .a * 
traming S^ing,- without any p.airticular training .approach in mind, from the inform^tibn ' 
obtained, Ah e training nianager or planner could make inferences about the kinds of ' • • / 
• training, ^pjs^ro^ches- that would be useful in this trajjiing setting. This approach ,might be 
• . -especially useful in developing, from the beginning, a'new' course or training program 

• r" ^ / - ■ .. 

.iRELATIOI^SHIP Off PROJECT TO RESEARCH LITERAfUREi 

/ Re^ch- literatj/re ..on social and organisational change is extensive and varied- 
S£o'!'*^^""®''^/ Chin,, 1969; Hay^ck, elal, 19?9; Sashkin; Morris, ^afl'd Horst, ^ 
The many /studies in. this literature deal with numerous .areas of (Change (ip/7 
. medicin^ifedUga«6n, agriculture, transpqrtation,. and generaj'technology, for; example)/ /. 
V jWiA with varioy aspects of the change process, such as the role oS change 'agents, th^ 
- . / mfluenc§ o^ n^s media, the communication process generaUy, resistance to change,' anci^ ■■ 
, / .conceptualizations of the change process. - , ' • ' / ' 

./- -This pn<^ect d§als with an aspect of the vast subject of social and 'organization^ 
/ change! th^ has not received much attention- in aihy of ' this literature-^the explicit 
/ considera«6n of the. user *s need's and -requirements as- a basis for choosing tlie partfclilar • " 
/ change 9* innovatiori to be implemented. The problem-solver model for social ichange 
. / (Havelo«?k', etai, 1969, Chapter 2, pp. 40-41)^does give user nteeds a contrail plade in the 
change^process, and the work of Niehoff (1969) on the factors -detertninihg the success or 
failurfof efforts to introduce planned changes ^in primitive of - underdeveloped societies . 
strongly emphasizes the importance of Hisefs* needs, as perceived by the-use^s themselves, ' . 
in determining success ,0^ failure of attempted innovations. Otherwise, this literature is' 
^ muchjnore concerned fiih the processes anti techniques of getting changes' accepted and 

mipl^ttiented, than with the'choicepf what changes to attempt.^ ; ° ■ »- 

^/ This project may. be viewed as a contribution to a relatively neg])ie^d,ppect of the 
/ study of social and 'organizational change, although its primary '"import^ lies" in its 
s / potential contHbytion to more effective Air Force training. ^ ■'" ' > 

ERIC ' :. . \ ^ -32 ^ .. 7 




;* ' SCOPE OF THE REPORT 

V 



This report describes £he development^ of a preliminary version of the model, its 
evaluation by AirTForce training personnel in ^the field',, and it^ subsequent revision. The 
cunent version o^the model, with Supporting materials, is presented in stand-alone form. 
^There is discussion of the relationships of the model to Instructional System Develop- 
ment (ISD) procedures (Department m^^tlie 'Air Force, 1970), the .Rand Corporation's 
system for desighing programs of instructiolvMODIA— A Method of Designing Instruc- 
tional Alternatives (Carpenter, 1972;% CarpenterTand JHomer, 1972; Bretz, 197^; 'and 
Petruschell and' Carpenter, 4972), and to the Advanced Instructional, ^ystem (AIS)* 
* (Roekway 'and * Yasutake, 1973). The application ftf the model to several training 
iipprb aches and training settings is described! . , 
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DESCRIPTION OFTHE.MODEL ^y>^;'€/' ' 



Chapter 2 



PURPOSE OF THE MODEL ' : . '^^'^/V // ^ 



- < 



The specific purpose of the model is to fkcilitate;.^and:!pii^de^tor^t for the 
' . systematic gathering and arranging: of information on /the characteifetics of training 

approaches and training settings' sp' that the "fit," or potential Gsefdlhesg-'of a particular- - V- i 
approach in a particular setting, can be evaluated. /i' \ .>■ ' 

-The proced^ure has. been, essentially, to ask a. series .af questions about the training ' ' " ' " 
approach under consideration, and a paraUel series about the training settings Thus the 
function of the model is to aid in eliciting and arran^g information so that all relevant ' 
- mfoi:mation is obtained and arrayed, in a way that facilitates decision-making. The final 
V- decision concerning the extei\t to which thejtradnjng apprqaeh fits" this particular training 
gi^settm^ remaim a matter for judgment^^uC;go_od,; sound" fudgpient sho\ild"be made much 
^ ^—r^asier-and mor^^ikely if the relevantrinformatpn .-is 'available and clearly-.displayed. 

• ' '\ >, '. '' V , ' ■■' ■■ • ^ 
. II^TIAL DEVELOPMENT ppTHE MO'dEL ^ , , ' 

■~ • The derivation of this.^^del ,was^ tegun by considering , a nu^obe^'ot - Ira&iing • ' 
approaches and asking the qtifestjon; "^'at features do these , training/approaches "have^ 
that would , make a;, difference in^tiejur^suitabUity^ for use Various training settings'", . ' /' 
From the |irst tentative answers .t6- this question, the fo^wii^g p'^eliminary outline'^arr V?^ 
characteristics emerged:. -,/'■' -\ \ •: , /■ Jj- 



(1.)' Student Q^^'^^teristics^ \ V ""■'/,- ' 



I a- Is the'--triiirimg approach senative to; ^ . .- 

; b. W^^'is^the^mihimum n'umberxof,sVden<^quire^,'f6r,!the'^app^^ to.' 

How does the approach- ^dle nfii^h.,1^er numbers of ' 

; C; W|iat/'is the suse of student ^grdu^is^'reqmred ^o^^^^ for .the'' 

. Ij / /;approach, and how-are they oi^ai^ize^,?/ K' \ i •' / -v' • . 

/' ' •'?vAr#^aiiy special aptitudes or fcapa^a^^^ ' - ' / 

y Reading ab^'ty at a specified level)? Y,;'/'! ;■ // . ' yV/' :■' 

'II^'5puc^^^Cl^cteriptics/^ ^'/'s ':• V'>- ' '' V'^-J » 



Instructor- , / 



■ - i' T in.4K\J<fcES, Plafy' ,in implementing the traSnJhg approach 

^y^^"^ ^ the /nature, pfA-'the- actiivities required/df '.instructore- 
"*:.-.'.P|^P<^ing informatidn', managing studehf/eai^ling activities/evaluating 
<'f^^<ija^ntperfonnandfe)f ' .'.y/l/' - ' .W ^, 

(3) Trdipinis^ Content eWj^^ps^ics . '—^^^^ ^ f '■ 



t 

r • 

I . 




f " /-^vv^^^ P^i^^^ ^ tramlngl 5etkog^ .instoicloiTS, training cggiteni,|' ; , 

' and/ pntys(c£5^ ^^^^^ itptr nrecoAceived^jt^ emerged as a;* * 
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TESTS)0F THE PREL^IMiriARY .dUTUNE OF CHAR'ACTERISJI^S^ 




The preliminary outljiie of char^qt^rislics vCas then used in exaniining a. numb*^ of ^ 
training approaches tp obtain ah indication of the feasibility of thi^ manner-^ d%e^^^ .^^ // ^. Z; - / 
the, model. Some of/the Jtein^^.apprpaches selected for' exanii^ailcui, weJe^bs /J\^\ 
fxoici^ HumRRO training, research;, r.and were intended to, represents the kind of.^^ji^i V , / i 
"^mental, systematic appitoaohes.to txaining .that' appeared to' offer substantial possibiii<5<^.^,,'!,^; 

of improvement in the effectiveness of training. Also^ because: ^f. tlieir relatively f undaj!^^, ^ , /' 
\ mehtal and comprehensive nature; they are' likely to be mor.e difficult to evaluati^.;m^ \>^/ */ / 
simpler training approaches inVplving, for examplle, a new audroVisual devicef. Thus^ -£hj|/^^ . , V J 
first tests of this developing ipojlQl were of substantial difficulty /and, scope, ^' * 

: / . Als6 .intruded in IJie Jfaining approaches selected fpr examination was' theJCinc^l^v ; «^ ; *' 
Training /'System, ,w^ cpmpjeteLy on a sophisticated piece oi^,i^trurf;6hai j ;^ - 

equipment. This traihinj^ a|ipro?ijbh was selected/ in qrder tp extend thj^. te^. 




' } the nature, and results of that examination, are describ 

l]r. rv;. • • ' f^K' v 7 

//, , !mijts training approach and ;th4'^oUowing one. (>lasrery.T^6 j , . , 

tije re^kch conducted unde^^HwifiB^ . -, Z 



Peer .'Instruction ^;i^irir(i^,^pproAch is Refined/as a-^jy^sterti.of j . j*"*!:^ ,/.^*,-, 

' a^e suc^srfttUy gpmpleled a/mojd^^ . ^^ V^ 




•V' 1 ^ ' ... ' 

i ■' '' J } (•l)yStudent Characteristics 

')■'■/ 'I /» ''' '• f- Insensitive to aptitude variations 

;f..'' ■ '■ . Minimuni numbpr of persons nuiSt Be in tralhing;"depenS^^ 




/ JX^9w^^ of individual student-leanieri v ' / . : />. >t • « - • 

/ * /'//,/' ' 5a/;i^im>lfej(r^^^ few; instructor-stud'^nt rktio-nqt iriti'caj / . . ^ 

. ' ^ ^'Sgfeci^MiH^ or training^one- other than reasonably prbfiGieni in training ' 

/ " Z-^* / . ^-^^-y RcJ^pt i^tructpi^^ schedulers oif instruction / * ^ 

iL ^^i^'^^^"^^ /' ^'^[ Appropriate, ^p^a ^ide' variety, of ty^es of co/tent 




c. Kequirements, forrtraining devicesfsep^ds on train/ng; <foht^nt, ancJ'ivCshether -^jj 
J 7',, -use of oprntfon^ ^ 
' *> . ' d. RfeA^iretiient for printed matermljn^bima^ 

''^ .-"keeping biily)'if job-related equi|fm^ntt^is used; ^Tearneif .^^^^^ V ^ . 

; , - : * • printed material, there is a larger te^to^^lent . r ' ^ J^v'. It -S^ ' 

7 ./ ■ ' ... Dispersed or remote sites-probably ti/o^' unl^^ opex^'tibnal- equibmeift'^^^^ } / 



e. Dispersed or remote sites-probably {.nb;^ unless oper^atibnal- equibmeify^oXr^^^^^^ / 
such sites is used with traveling admij^trator-trainer te'amk * i^-v^- / "^' ^ - '^^v 

Testing (With Modularized Training) \, 'ff^ ^ ^ " 

/ ' ^/l^e Mastery Testing -Tbining Approach b defined asf^^^^ 

/ - ' ' .required to_demo;wtr^.t^^cceptable performance on a mb&uie of training coiijent b€K>i'eVO/. - V** 

' " beinfiTalldweH'tb* cdnfinue with the next moHulp .^hiHpnfe 



; (1) /Student' Characteifistiqs 

i . jf-aMrisensitive to'aptitude variations, • '^V * ' 

--r.b. Numbers, of students requirecj or permitted not crucial;, large, numbers of 
• , '/^ students *;can be accommodated by having multiple ^testing stations, for 
' " . {each module ^ ^'-'f-^''^!^^'-'^^"' - 

c. No necessary implication for size or organiJI^n of studgAt^grou{^^"^V^^''^^"^^^^^ > 



d. Special aptitudes required; depends on performance'being tested Tf^ 




I 

i 



: -.'If, 



(2) Instroctor.. Characteristics 

-a, ^^iWl^r req\iired— depends^ on numb§r of modules of training content and. 
^ JjaEQ^i^ of students; not fJarticulafly heavy -requirements for instructors 
.V >i)i/opecj^ skills or tia|ning--:^ admiriistratibn, quality cpntr^fl orientation 



^ :iyp^ii$nteh| a^r^ . variety 

. b. Impff^^tiptis '^qr training" content-~requires 

^iBOdulairmtiQp^f^ content, approach is particularly appropriate if 

V ^spmg parts of Itrkining^ content are clearly prerequisite to others \ ^ 
ip4): P.hyjSfca^&t^ . /\ 

r a. -Am^nt 'ifeidjfcind of space needed— depends on nature pf job performance 
: beii^t^ained, ' • " ' " / 

b. Requirenfent for operational equipynent-^esirable when possit)le, but simu- 
< laltSS: performance can beaised , \^ ' , * ^ 

c*. Requirements, for training ;devices^^sirable if possible fot more realistic 
t^st^g in some cases, (ficielity requifements de|)^nd on training content) 
' . d. Reqttiremehts for printed m^rial-TninkQal/ -unless -testing procedures 
require a great deal of printedjmaterial .. , ' ' *v * ^ 

e. Dispersed or remote sitep4iormally not, but .cpuld'be done vsrith traveling 



testing teams " 



Lincoln Trainin^^stem (LT^ 

* ^ -This traii^g apprMen was taken from the, description pf the equipment provided by 
Frick (1973),^tiHtS'''use in demonstrating an economical metholl for pireparing^proce- 
duralized instructional material <Frick and Ka^^ 1973), ! . I . ^ . f > 

The Lincoln [Training System Training Approachli& iiefined as a «>mputer-controlled, 
stand*aione nilcronche system that combines >^§uaL images^/ Toice-qualjty sound ^recordings/ . 
larid computer control logic on^he same fiche. Upder -oamputer c(ii|troi; the^sfiem can 
, select any Qtu|x-' to 750 microfiche, eagh wlth^'* 1^ images, and 12asi6ciated au'^io frames, 
with upr*to^, 28:seconds of speech on each frame:; The /System pre^eAjts i^tiiivi dualized, 
interactive in^ftniciion utilizing both visud and auditoi^^^ # : ^ 

* •» , ^ ' / I'-'-j/': \' ' - V ' •/* ♦ 

(1) Stuilent piaracteristics ' * * ''I^'- /-V.. - '* ' > J' 

a./Ap)ti|ude level -of students— not applicable r xlepends t)h^^i^at 
; tionffil material/ designed for use in equipment v ^ *'r/\ ' ^^'''^ ' 



b;/ NiuAber.^ students— one per terminal Wlule^in-us^ •//> 
Organization pf students— none— indiWdti^lized'ftsfe^ 



X 



b. Specisd^skpls or tram{n^^inimal,^?iisuming ti^^^^ rt\ater^^good 

c. llple.;;of' instructoiS^ninor involvement (issulpg^'^^ts df'/g^^^^^ record 
, keeping, etc.) ^ ' /''fl'^ '/ ^'W'* 

(3) .Training Contei^t Characteristics ' ' ' f!;J 4' ^ . /' ^ ' ' 

^ a. Type 6f conjtent appropriate-wide range possible^ // / /^ivW-^ o 
Lb. Implications tor oi^anization and sequencujgJJQf training cj^^^tT^ra^l-step 
^ inherent in system, flexible sequencing|^<^ib]^7^'^^^^^^ 
access .capability ^ ' . ' ^ 
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c. Training development and revision effort-development effort -varies widely 
^^epending on approach taken in analyzing training content-, ^equipment dpes 
riot impose. burdens here. Training revision effort is less than for 'comparable 
printed; materials, since 4ai^e production volumes are not needed for 
economy in making microfiche, as with printed materials » * ** 
(4) Physical' Setting .Characteristics ' . ^ * ^, 
*c .a. Space requirenjents— indoors; amoiint needed 'for one terminal per student* 
during the time on the system / 

b. Requiremehtsv for operational equipment-tlepends on how it is u^ed (can be 
used as a job aid in operating or maintaining operational equipment, or as a 
stand-alone training system) 

c. Requirements for training devices— probably none 

d. Requirepients for printed materials-^little or none \' * 

e. Can be used* at dispersed and remote sites for individual instruction 

Operational Coht^xt Training , ^ \ 

This training approach was taken from the report ^^VjIumRRO research project- 
(Work Unit LOCK-ON) carried out some years ago (Woolman^ I960). It w^ chosen ia- 
ord^r to extend the tests of the developing 'model into the area of on-the-job training, 
an^ because the approach, as applied in the original HumRRO stucly, produced a rich 
amalgam of training techniques well adapted to the constraints and requirements of the 
field training situation for which it was designed. 




The Operational Context Training Approach is defined as a flexiSle, decentralize^ 
method of -OJT, utilizing as its primary training unit a group consisting of one in^truct^r 
skilled and experienced in the job to be trained (but not in instruction techniques) and two 
students. The method also involves: ' , ^ - ^ ^ 

• A» Training Guide that describes tKe method generally,and provides specific" guidance 

on the procedures ror skills to be lear^i^d by students. ^ 

• An elenjentary njethod of insti^ction for the guidance of novice instructors. . ^ * 

• Training content organized in modules or blocks, with « 

k • Proficieniiy-based advancement in training, based on . * , 

AA simple six-point rating "scale used^by the training unit instructors during, ti^iining 
and by training supervisors for qualifying students to advance to a later module of 
training. , * * 

• A system' of record;^ . and charts to record and display, student progresfe for both 
'""information and motivational purposes. ' 

^ X, An interviewing and Counselling system'^ to deal with students whose performance Is 
^^^^ unsatisfactory.'^ - '\' / 

"'^e -mfethod U d^i|^i^d^to be used in ^ field^ or operational s«tti^|J^and .depends 
heavily on^ "relStiyeJ;^ Idw-level^^personnel who are given explicit guidai^ in following 
the system. " \ : ^ * • \^ 

(1) Student Characteristics * ^ 

a. Insensitijfer:^ aptitude Va^iatidns^ ^ , 

b. Flexil5le as to numbers ^f students ' ' 

c. Two students to each inslaructor . ' 

d. No special altitudes required/ 

(2) Instructor Characteristics * ^ ' 
a." One instructor for every two students, with five or more such training units, 

one chief instructor, and two or more supelryisory (check-out) instructors for 
each platoon-size unit . - \ 

No special skills, beybnd those of the performance being taught— complete 
instructor guidance provided in the method \ 



c. Role of 

students' practice^ andv evaluate per|bnnance. . Supervisory instructoi:s 
administer' proficiency tests *or rating^, 
monitors training program for platoon 

(3) Training Content Characteristics * 

a. Typ^ of content approj)riate-^hould be 
dural jobs. 

b. Modularized training content, sequenced according to prerequisites, other- 
wise modules can be studied in any order,* subject to equipment availability 

(4) Physical Setting Cl^aractepsfip^ f 

a. Space requirements-^ojna beyond that required by the operational equip- 



in structors-rdepionstrate per^onhances, observe and critique 

rmance. . Supervise 
Chief instructor supervises . and 

suitable for wide variety of pfoce- 



} ■ 



^ment • <a ^ 

b. Designed for use o.n an,aS-available basis ^ith* operational equipment 

c. Requirements for training devices— probably none, since ogetationai equip- 
ment will usually be.used . * - ^ * 

d. Requirements for printed material- 



e. 



'Training Guide and record -keeping forms 
Dispersed or remotie sites-^es, if operational equipment is so 'located 

As these training approaches were examined, itfappeared cle^r that they t^ould be 
evaluated with respect to the characteristics presentedAn the preliminary outline. Fiirther, 
it was felt thai the product of such evaluations' woi^d be a summati(|p of the" significant 
factors to be considered in making d€fcisions conceri&ig the suitability of these t3:aining 
approaches for use in particular, training setjtings. 



AMPUFICATION OF THE MODEL 



At this point* attention wa5{^ift€^ to various^ffeatures known to be involved in 
mUitary training settings, and the cfuestion* was aslced, "Do these features of training 
settings make a difference in the feasibility or suit^l»ility of various alternative training 
approaches for use in these training settings? If the answer appeared to be "yes,^* these fea- 
tures of the training settings were^ incorporated into the outline of characteristics. ^ 

.oc^ome of the items in the amplified outline of cji^pteristics appeared to relate more 
to training approaches, and others more to training settings. Since the* model was 
expected;^ relate to both, and to serve a 'kind of irifediy ing f unq tjon between them, the 
amplified outline of characteristics was then recast* expl^jKyinto two paralWl, coordi- 
nated series of questions. One series of quelstion^ ^as directed at the traming approach 
being considered, and the other series at the training setting involved. f 

A brief outline, of this interim version of th^-model is presentgd^ For this 

version, which was used in the field evaluation described in the following chapter, each of 
the elements in the following outline' involves one or .moife question^rcondeming the 
training approach, with parallel questions for the training setting. . - 

^ STUDENT CHARACTERISTICS , , - 

A. Implications of student aptitude levels , * ' . 
. B. Numbers of students ^ 



^ This version of the model was developed in an interim ^report by^Edgar M. HaverlHnd in March 1974. 
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, C. Special skills or physical charactemUcs of students 
D. Implications of sex of students \ 

INSTRUCTOR CHARACTERISTICS \ A. 

A. Number of instructors , , 

^ B. Special skills or training of 'instructors 

C. 'implications for roles to be pla:^ed by instructors " , 

CHARACTERISTICS OF TRAINING CONTEN;;r^ 

A. Kinds of- student performances , ' -fr-- " \ 

B. Oi^anization of training content ^ ^ * 
^ . C. Kinds of instructidnal activities 

D. Effort necessary to make changes in training content 

MATERIEL AND FACILITIES . v ' 

A. Space for conducting training ' * 

B. Equipment'^and materiel 

C. Training locations/situations (formal '^hooll on-the-job training, 
dispersed locations, remote sites) ' 

ADMINISTRATIVE CONSIDERATIONS ' ^ ' 

A. Student flow A ' ^ ^ 

B. Individualization of /instruction* , 

,C. Fixed standard level of skill expecte.d^of students, or each student 




develop his capabilities as far as he can 
DN^anageipent^information' * 

COST FACTORS 

A. Capital expenditures . . - 

B. Operating expenses • ^ , 

C. Training development costs > j),. * 

D. Miscellaneous costs ^ ^ 



\ 
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. Chapter 3 

' ' ' ' i ' . • . • 

FIELD EVALUATION AND REVISION 0^>qHE MODEL 

; . • • ■ ■ 

PURPOSE OF FIELD EVALUATION ' 

The field evaluation conducted in this project had two pur^ses: (a) to subject the 
model to criticism by the Air Force, training personnel who are its potential users, and 
(W to obtain information concerning a nximber of training settings so that the revised 
m#del could be Smjplied to some of these training jSettings;^ Tlxe version of the model 
en to the field was described in Chapter 2 of this report. 



ta^i 



SpURCES-OF INFORMATION ' • 

6ince this project was undertaken in the context of Air f^orce technical trainings 
information was gathered by a team of two researchers at Air Force Technical Training 
Cei^ters at Chanute AFB,^ Rkntoul,411., Rosier AFB, Biloxi, Miss., Sheppard AFB, Tex., 
and Lowry AFB, Denver, Ck)lo., as well as at the Military Training Center at. Lackland 
AFB, San Antonio, Tex. All of, these Centers are elements of the ^U.S. Air Force Air 
Training Command. ^ ■ ' • * 

~>vCriticism of \]xe model - was obtained "^mainly from pSspnnel of the Curricidxmi 
Branches' of the Op^erations Divisions^in t^e Schools of Applied Aerospace Sciences, and^ 
from chief instructors and instructor suparvisots in the instlructional departnaents. 

Infomiation concerning trjaining settings was obtained by observing training ^ctivi- 
^ ties, disclJ^ing the process and problems of innovation in training with personnel ranging 
fixJbi department and division' directors to instructors, and by obtaining documentation 
on selected courses for later stiidy. . * * " 



SUMMARY OF INFORMATION OBTAINED ^_ 

' ' ' * T ' ' . - . 

[The ^primary method for obtaining criticism^ of^. the model was to request that a 
meeting of 7 io 15 curriculum and supteryisdi^ instructor personnel be convened at each 
Center,- and to present thfe model to them for their reaction. The meeting lasted from 
one to three hourd. After those present had been acquainted with the objective of the 
project and the in^nded uise of the model, the model was worked through section by 
section^ Some j^of^tjie -topics discussed included (a) whether the information 'needed to 
answer the qiiestiotis in the 'model was available; (b) whether any of the questions were 
inaf)propiiate or irrelevant; -and (c) what additional questions should be ask^. ^' 

Although! at %nes in these meetings it, took some^ effort to establish communication, 
the discussions ytfxe^ variously: intense, interesting, constructive, explosive, critical, 
complimentary, and helpful. In 'ishort, the meetings were anything but' dull. ' 

The major pomts made /in criticism of the model were the following: ^ 

(1) ,Cost^ considerations ar6 paramount, in considering possibly changes in 
- ,irainmg procedures and methods, and the order ,6? topics in the model 
. '^j- ^houlq be changed so that questions abont costs are answered firsts 



' ^^^H^^ 1S2^^^^9^^ written in 'tenuis familiara to^^the intended uSers. For 
TOos£""peopl4; this meant that^'jlhie JerminoFogy ^d concepts used in the 
*^ model "should be those used, in Air Force -and Air Training .Cob- 

band Regulations, • ' • ' ^ 

(3) belays in obtauling instructional materials, equipment, afld personnel are'*' 
important when making any substantial change in traifting, procedures anfd 
' - ' ' Njnethods, and should be given' nuore explicit attention in the model 

* (4) Th^ various roles' that instructors may play in different training approaches, 
the difficulties of changing the roles; thiat -instructors play when imple- 
menting- a new training approach, and somfe definitions of varidus kinds of 
instructional personnel should be made nipre explicit in ttie model. • 
Inl^dditioh to these major points, dozens- of * detailed sujj|estions were 'made. 

;pie model w^ revised, taking into consideration all'of the information obtained, 
andis presented in Chapter 4- of this report., . ' ' ^ 

? In gathering information concerning training. .settings, Jthe research team asked the. 
personnel interviewed to think of substantial changes tfiat had recently been made -in the 
training for which they were respfonsible, and to discu^ the^«f)rocess by which the^ 
decision to change the . training was reached, as well as the difficulties encountered in 
iinplementing the changes. \ / / 

Nearly everyone had either participate^ in the implementation of a sUb'gJ^tial 
change-^ training, t>r knew of the experience ot another ^dfepartment that had done so. 
The most frequently encountered change in training involved converting a* course or a 
major portion of -a doUrse (usually from g:^oup> lock-stgp*" in^truQjtjon) ^to self-pacedl' 
ihsjtru,ction. These conversions were accomplished > by devising aoli\^ties,. usually pro- 
grammed textbooks or exercises involving operating or checking equipment, ^hich 
students could d6^ largely or entirely on their owfi. Iijgtructors were there to help, if 
.necessary, and to administer tests covering segments or modulas of the instruction, which 
students were Required to pass before going further in the course. . ^ 

These substantial changes^ in training had usually 6een macje at the diredtion or* 
suggestion of Headquarters, ATC, although in some^ases individual training managers had 
taken the. initiative in implementing the change. " ^ - * s. 
^ The most important consideration in deciding * whether to implement the new * 
training approach was always cost, thus verifying t^e major change r^ommiended in the 
model. Changes in trainmg were pd^ble 'only il thfey could be^' implemented \^h ' 
available resources, or in soine cases with a sm*all amount of additidnal resources (funds, 
personnel, physical facilities,, and equipment). QtHer "factors, sucK*'as projected student 
flow, quality of ^radu^ltes' perform£ince, and the^^ne^ for reorienting or retrying 
instructors^played a p^ in some of the decisions, btit were riot ^sistentjy involved. / 

In »umm^|j^-'no evidence was found in these discussions, which took place in 15 
different instruction^ departmenti5,*'6f a decision process nearly as comprehensive as the 
• model would provide for, matchirig training a|)p^aeh^^ with t^^dning settings. * 

At each Tjechnical .Xraiiiing Center visited, the research team r^uested and received 
documentation for ^several representative courses. For each icotfee,^ this documentation 
consisted of the Specialty or Course Training Standard (STS or CTiS), the Course Chart, 
and the Program of Instruction (ROI)/ These course documentSfeon materials,' supple- 
mented by the observation and interviewing done ^ by the" resejlrcH. team/ provided the 
basis for the applications of the modfel to training' settings des'bribed in* Chapter 6 of 
this report. > - ' 
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REVISION OF THE MODEL ' . 

The major revision to the model was the reordering of the major sections so that 
'costs,, or TOoje generally, resources, are consMered first. Also a short section, Objectives, 
was added tlje begnimingjo focus on what diould be accomplished by 

* adopting a new ^|faining-appf6acE7^^! , ; ^ 

Air Force and Air Training, Command terminology was used Somewhat more in the 
revised model so that it is, to a considerable extent, "failored'*lor Air Force technical 
training. However, general terminology .was retained to some extent in the model so 'that 
its potential application in a much wider context of training |;echnology than Air Force 
technical training would be recognizable. . • . 

Delays in obtaining instructional materials, eqijipment, and personnel, and other 
administrative and logistical problems involved in implementing a new training approach, 
were ^ven considerably^ more attention in the revised modeL Generally, more explicit 
empljasis was placed on the management of instructional equipment * ajid materials, 
instructional personnel, and students. " . ^ 

' The repsed model also goes into more detail about the kinds of j^ctivities in whi,ch 
instructors ^fengage, the problems of changing, the roles of instructort when new training 
apptoaeh^. are' implemented, and the kinds of auxiliary personnel thajt are needed in 
^som^^ inra^ictional systems. In, conversions of courses to the -self-paced mode, the 
prcrt)lems of changed rolte for instructors and of re^r€4ning instructors t» work construc- 
tively and effectively with students in a self-paced course had been menftoned frequently, 
so these aspects were incorporated in the revised^^roSdel. , ; 



chapter 4* 
THE MODEL 



The model is presented in this chapter with supporting materials as it might be used 
independently of this report as a separate, stand-alone method for matching training 
approaches with training settings. It is in the form in which it might be given to Air 
Force training managers and planners for use in their work.^ 

Introductory and explanatory material is presented .with the model to facilitate its 
use. After more exjierienee in usin|5 the^odel has been accumulated, it should be 
possible to specify a definite step-by -^step procedure for niatching training approaches 
with training settings, as well as to improve the model itself. 
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limited number. o£ copies of this model as a separate, stand-alone document are available. 
Requests should be sent to Dr. Edgar M. Haverland, Eastet^n I^vision, Human Resources Research 

Organization, 300 North Washington Street, Alexandria, Va. 22314.. ' ^ 

0 , i 



23 



Jrainrng Approach 



OBJECTIVES. - 

* * * * * 

, What is the general nature of the evidence that indicates that th'is 
training approach might improve the performance* of the training' ^ 
system or solve the problems affecting it^ (Answers to later questions 
in this model will explore this in more detail.) The^following list 
describes some benefits that might be gained by adopting a. new X 
training approac^: " ' 

^ Reduce student attrition - * ■ 

• Improve job performance of graduates 
\ 4 Save'traiijcng time • 

• Reduce training costs 

• -Adapt course to students of lower (o; higher) aptitude than 
previously , » 
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RESOURCES REQUIRED 

A. Implications of training approach for costs. 

1. What capital expenditures will be necessary if this training 
approaches implemented? Examples of capital expendi- 
tures-new or remodeled facilities, or equipipent purchases. 

2. What l<inds and amounts of operating expenses wiM be 
involved if this training^approach is Implemented? Areas in 
which operating expenses may be important include per- 
sonnel, physical facilities,, and instructional materials. 

3. % this training approach fi^ implemented, yvhk l<inds and 
arpbunts of training development costs will/be incurred^ 

' Both initial training analysis and development costs {job 

analysis, trainihg content analysis, development of the 
instructional system, and* development of the training 
materials) and the cost involved in repeating these analysis 
I and development steps when the training content \is 
changed, should be considered'. 

4. Wheh §tl""€Qsts of implementing this training approach are 
considered an^'thes^costs are distrijauted over the number 
of students lil<ely to be trained, how does the cost per 

/ ' student compare with that, of 'alternative training 

/ approaches? ' , 



OBJECTIVES 

What •|i^€--yy r objectives --with respecjf to this training setting? 
VVhat gSals would ^you like to se^ the training system attain? Wh^t 
problems xio you, see in the training system that need to be solyed? 
The following list dejscribes some goals that might be achieved by 
analyzing the training setting and making soma changes: 
^ Reduce stud^t attrition . ' 

Improve job^performance of graduates / ) 

Save? training time • ' '^^ 

Reduce training costs \ • * ' ' ' % 
Adapt course to students wjlower (or higher) aptitude than, 
previously y\ * ' . 




RESOURCES AVAILABLE 

, A. Availabifity of funds in this training setting* * , 

1. Are the funds available in Xh\i training setting to covej^the 
capital expenditures TTecessary to implement* this training 
approach? , , . , 

, 2. Are fiind^ available in this training -setting to cover the 
operating expenses that this training approach 
would involve? ^ - ^ J ' 

3. Does this training* setting provid^for necessary training 
development costs, both vvhen the\(;aining appfoach is 
initially implemented, and when changes m^t raining content 
giaKe it necessary to partially repeat the. training devel- 
' ojiment steps?* ' ^ 
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4. What is the currenjt- cost per student trained* in^ this train- 
ing setting? I 



TRAINING APPROACH 



5. Will this train ifig approach permit the sharing of expensive 
facijitles or equipment with other courses, or with opera; 
tional uses? . - ' * *" 

6. Will implementation of this training approach result in 
' ^some Equipment no longer being necessary? 

B^. Materiel and facilities requinements for this trainlhg approach, 

1. For what kinds of training locations or situations is this 
training approach suitable? Examples are shown in the 
following list (additioital kinds of locations or situations 
should be considered if appropriate) : 

• Formal school training, of a continuing* najture 

• Special school training, of ^ one-time nature 

• Basic military training , 

• Qn the job training * , » * 

• . Field training * 

• Learning resource center 

Disperse?! locations ^ 

• Remote sites 

2 /^Sp^^e requirements. ... 

a. What kinds" of space. arjB needed to use this training 
approach with the 'training content beiog.^qnsider^? 
V " Examples of kinds of space: , ^ 

• Classroom. 
*• Laboratory 

^ . • Practical exercise facilities ^ * 

• Outdoor ranges or maneqver areas ^ T 
Storage ' \ 

^' , ' 



\^hat amounts of the various kinds of space are needed 
("at least in relative terms) when comparing train- 
ing approaches? ^ * 
-What elements in the training approach or method are 
related to space, needs? Examples; 
• One classroom^for each class of students. 

One terminal for*each student using the system. 

One learning station for each module of content ' 



. ' TRAIfsriNG SETTING 



5/ Are %l\ere in this training setting facilities or equipment 
u^ed in other courses, or for operational purposes, that 
could be used with tfiis t^^inin^ approach? 

6. 'WHI turnirig in unneeded equipment resttit in savings in 
operating^ or maintenance expenses? . 



Notes 



6. Materjel and facilities^avaitable in this training setting. 



1, 



What kinds of training locations or situations can be pro- 
vided in this training setting? Examples are shown in the 
following list (additioris to this list should be made 
if needed): 

Formal school training, of a continuing nature 



Special school training, of a^ne-time TOture^- 
Basic military training ^ .^--^^^ 

On*the-job training'"'^ - 
Jield trai 

Learning reSSurce center 
Dispersed locatibas 
Remote suites 
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d. Does the training approach 'require that the space to be 
used have special utilities or characteristics? Examples: 

• Electric power requirements 

• Air conditioning and ventilation requirements ^/;^ -t ' 

• Lighting requirements ^. • . ' <"'v^;^ 

• Floor loading capacity' ' / V V i'*/ ^ ' * 

^ e. Are environmental extremes ^heat, cold, humidity, etc!) 
important considerations in using tfiis training approach?,' 



/ 



3. What kinds'of equipment and materiel are required to u^" "1^ 
this training approach with the training content being con- 
sidered? The following list suggests kinds of ^uipment and 
material that may bei .needed (additional types of equip- 
ment and material should be listed if heeded): ' . 

• Operational. equipment / 
^ • Nonoperational equipment 'if . 

• Audiovisual equipment ' . , , / 

• Filrns, audio and video cassettes ' 

• Part-task training devices * - ' v* 
Low-fidelity simulators * • j\ 

• Large, high-fidelity simulators , ' • * 

• Training aids (charts; transparencies, cujt-aWay 
equipment, etc.) : 

• Study guides. Technical Orders, or other jarinted train- ^•-^'^ ..^ 
ing material I . . * ' » * 

• Job performance aids ' - :^ t 



TV 



•J 



•<':f 



\ 



:r?f- 



ERIC ; 




4. Instructional equipment and materials managefnent. : ' i 
' a. If this training approach Is implemented, and eqliipment 
' of. any complexity is to be used in the training, does thd 
prjoject^ utilization schedule for the equ?pmehtfprovide 
time for maintenance? ■ . I ' | * 

b". 1^ ^js training approach compatible wPth tfiJ use. of 
1 ij,' j tKairiing materials with a security .classification? f 
' Vc: v Does 'this training, approach require thd Xise bf copy- 
'Trghte<J.mate/!^ls? ■ ^. ; I rj* )i [. 

d. In plann'i^g/fbj^ *the implementation p^f:ttvlsr^^ainjing ^ 

approach, hive afl6w|rices Jpf^ri rnacj^] fo^^tK^i^^^l"?^ ; -I'/'^ /' ^' 
nwessary to ofetiala any.ne^ * '^p// 



* /.- 

V/v ' 

• I'ft,- • 



■ m 
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-// / •. ^ < 

d. Does the space available in thistraining setting have any 
specials utilities or , characterisjtics that are needed? 
. ' Examples:, 
• /Eleqtric power requirements , •. 
, , Air <6onditioning -and ventilation requirements 

/ Lighting requirements* * 
, ' if Floor loading capacity' 



Notes 




V'vtr — 




' - ; e. [Are^there eilviForlmental extrennes (heat, -cold, humidity, 
^ ' etdXfo be consider^*; in this trainiria setting.? «: J 



V'si What! kinds' ^nd'^amaurjtsiof equlprr^nt and'';i^^ ' ; (; \^ . , 

' conducting training are avaijable qr«carf be ob^ipedJi6,'tWs!^^|rf ^^5^ 

i; 'training,^ settiriq,? The* following flst ^sugges^s^fh? kirfds;a\ ^* ...7^' \ 
* ' . equipment an|i: 'rtiat'erWl ihat .nri^; bfe .aviilfi^^ 

types, bf equipment and materfef sKduld'. * be- listed * rK. 
if rteededi: 1 : - ** . 

. • ^Operatio'naJ ^uipmept ' ^' , ' 

j" • * Ndnoperatiorjal equiprpent * ^ 

'/^ • • ' /^(udiavisuai fequipment" / 
\^ : . Films, audio .knd video cassettes , 

v « P^rt-tas_k training d^^ices - * * . ■ ^ ' 

Lbwrfidelity simdjatQfs^ - 
• Lai^e, high-fideilty^sfrnuiators 
\i Training aids (chart^, 'transparencies, cut away equip- 

Stud^ gUicte's,;jechnical Aders, orother printed training "jL./ 
- fnaterial ' V' • • • i . ^ ^ 

4 Job performance, aids , , ^ a^A?^^?.' ^' 



trainina setting.? « , * M ? - - 



4. Policies andf.resolH^es affecting instructJpnal equipment and • 
materials managefi)ent/in ^his training setting. . 

a. Are /he resource ^^'^skills ne^ed^to. maintain equip- 
* ment'used in tKining availably in this training setting? 

b. Will* the use of u)ajr)ing materials vvitK'a security classi- 
fication be .necessary MrfthTs training setting? 

ci Can permission to U^" copyrighted materials be obtained ' 
in this training sfetting?^- . J^ ^/ ^\ 

d. In this trainmg.iettin^gj^yjvhat are th^]^d'ti.mes involved 
in oBtaininq equrp(rient needed for trajnin^? . 



^rj, 



.V.-- 



/■Si: .:• 
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TRAfNING APPROACH 



♦^e'i'Poes tfij^s training approach require base supjpert for 
pnnting, or forvthe preparation of slides, audio or video 
' tapes, or other^audiovisual materials?* If -so, has provision 
been made Nn planned schedules for the lead 
times involved? 

^ctor requirements for this training approach. (See section 
fifstructi'onal Personnel) 
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INSTRl^ppNAL DESIGN AND MANAGEMENT ^ 

Do^ this; training approach have implications for whether the 
^^^^^ paced or individually paced? The 

fol^wing list describes a number of kinds* of instructional, 
. design: - . 

^ •J^^^^^J^^^ step: Students receive instruction in groups and ' 
'^It jTiembers of a. group pcsgr^ at a schedujed rate, 
^'■^rbup^ pacing: Students progress through the;instruction at 
rate determined by the abilities of the gr^ as a whofe. 
fi;gups; of^Jiomogeneous , ability levels may be formed 
ruJLtTpfeiracks)? 

TaSnostic jproficiency individualization (modular 
:hedcilihg): S*tudents a'fe testid \o deterrirlne whether they 
1^ to study sections of the training content and may'skip 
my training content that their test performance shows they 
^ave mastered. 



Students can study extra 
''^'Cc^iining' material designed to help them make up for 
J\^^^i^ncies in their preparation. ' 

*^f^PPi^^^?'y inc^ividualij^ation: Students are allowed to 
N:^^''^^^^^ blockof ^ course at one time. This 

^iR^^^^J^^^J^^^i^^ study assignments. 
^' %^^p^W'a^J?fation fself-pacing): Students may^ proceed 

?t)t^^i^wn pa%^ the required training materials. 

• ^lte/n^iy6^fp^hod^r ^ individualization (multi media 
mstruptlb(j)\Sjudeni^^ (at least part of the 

^ime). as tc^^^methooSy^c media they use in studying the 
i^r^ining conleht, : v . 





e. Is support for printing, or for the preparation of slides, 
'^audio or video tapes, or other audiovisual materials 
available in this training setting? VVith what lead times? 



C. Instruotor availability in this training setting. (See sectiofTt&n 
Instructional Personnel) ' 



\ 
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INSTRUCTIONAL DESIGN AND MANAGEMENT 

A. What are the policies in this" training setting concerning 
whether instruction should be group paced or individually 
paced? Do the kinds of instructional material available or 
prescribed for use in the in^ruction have implications for the 
design 'of the instruction? The following list describes a num- , 
ber of kinds of instructional design: 

• Group/lock step: Students receive instruction in groups and 
all .members of a group Progress at a scheduled rate. 

' • feroup pacing: Students progress through the instruction a\ 
a rate determined by the abilitieii^f-^he^rjDup as'a whole. 
Groups of-hdmogoDfiotis^jlity'levels may be formed (mulJl 
, tiple tracks), 

• Diagnostic proficiency individualization* (modular 
scheduling): Students are tested to determine whether they 
need to study sections of the training content and may skip 

vany training Content that their.test perjor^nance^shows they 
have mastered.' \ y \ 

• Remedial individualization: Students can study exti^ 
training mater ial'designea to help them, make up ^or defi» 
ciencies in their preparation — 

• Supplementary individuall^zation: SttJdents are allowed to 
work on mo^p than one block of a "course at one time. This 

• may include outside study assignrrfents. 

• \J^t& individualization (selflpacing^: Students may proceed 
' at their Jbwn^pace tTiroughlthe required training materials. 

• Alt^nat^ve-methods or media individualizajtion (multi-media 
instruction): Students have a choice (at least |)art of the 
time) as to the methods or m^dia they use in studying the 
training content: 



T-RAINING APPROACH 
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B. Does this training ap^roach^lndicate that a fixed, standard level 
of skill or proficiency is expectedvof graduates of the Pnstruc- 
' tion, or that each student is expected to develop his capa- 
bilities as far as he can, and'in areas at least partly determined 
by his own interests? J 

' C. Does this training approach make provision for, or have any 
implications for the provision of management information? 
The following list indicates some of the kinds of management 
informationrthat might be involved: 

• Information on students' backgrounds 

• .Information on students' progress through the course 
of Instruction ^ ' 

• Information on the addquacy of various parts of the course 
9f training ' ^ 

• Information on the adequacy of graduates' performance 

• Information on instructional resource utilization 



CHARACTERISTICS OF TRAINING CONTENT 

A, Is this training approach suitable idTthe kinds of student 
perf<;[rmahces that can accomplish (the training objectives? The 
following/llst of kinds' of ^student performances can be con- 
skJere<J when evaluating wKfether this training apprqach is suit- 
« able (any additional typ^ or terms needed to cfescribe the 
kinds of^ iierformances' specified ;*;t?V the training objectives 
sho^uld bje used also): ^ : ' , 

Recall and application of facts;|',) . , . " 

(Remembering the terminolc^y of an equipment system 
-^anrf the names knd locations of the controls so that the 
student can speak or write With reasonablig fluency con- 
cerning the system 
Making specific control settmgs 
Serial procedures . 
•••fixed \ ' , 

••• Energizing electronic equipment 
••^ Crew drill in a weapons system ^ 
•• Variable, or branching , . 

•••TroublesHootJng comple)c equipment using proce- 

duralized' methods and fob aids! 
•f^ Emergency proceikjres, which often involve branch- 
ing away from otherwise fixed procWures. 



Do the policies in this training setting indicate that a fixe^, 
standard level of skill or proficiency fs expetted of graduates 
of the Instruction, or that each student i& expected to develop 
, his capabilities as far as he can, and in areas ^t least pi rtly 
determined by his own Interests? ^ 



C. Does tHis training setting require that various kinds of man< 
ment Information be generated, summarized, and report' 
The following list indicates some of the ^inds of managemi 
Information that plight be required: 




through the cour^ 



Information on students' backgrounds 
Information on students' progress^ 
of Instruction. 

Information pn the adequacy of various parts of the course 

of training j . 

Information on the adequacy of graduates' performance 



Information on ii 



stractional resource 



utilization 



CHARACTERISTICS QF TRAINING CONTENT 

\ \ 

A. What kinds of student performances are heeded in or^er to 
accomplish the training objectives? The ifollowing list may be 
useful in describing these kinds of performances (any addi- 
tional types or terms needed to describe the kinds of per-, 
formances specified, by the training objectives shou|d^be 
u'iedalso): - ^ ' 

• Recall arfd application of fa^s " 

RemembVnng the terminology of an equipment ^system 
and the names and locations of the controls so that the 
student can speak or write with reasonable fluency con- 
cerning the system . ' 

Making specific control settings > ' 

erial procedures , ^ 
\Fixed 

Energizing electronic equipment 
rew drill in a weapons system* • " ^ 

Variable^'of^branching 

Troubleshooting complex equipment using^ proce- 
duralized methods and job aids , , \ . " 

Emergency procedures, which often involve brar^ch* 
in^^away from otherwise fixed "procedures 




Tracking and aiming -s, 
Radar tracking * ■ 

Aiming a gua 

Seeching and scanning 

Aircraft detection - . . ^ • 

•# Aerial observation 

Scanning^'uick seardh, subojjdinate to some other task] 
such as scanning irtstrument panel while driving. 

Discrete or contiguous performance * 

Discrete-ste^-by-step performance; with Jndivid'uar steps 
being clearjyjseparate elements of the performance 
••t Operating control panels in missile systems 

Assembly and disassembly of equipment 
Continuous-cannot be divided into clearly separate 
elements; continuing performance, usually guided -and 
modulated by feedback. 

Aligning or adjusting electronic equipmenjt 
Ridirig a bicycle 

Noiseiiltering-^etetting cues or symptoms ajnong a 

background of extraneous simulation 

Listening to an engine to diagnose malfunctions 
Detection of targets on radar scope 

Skilled actions-activities that the untrained person cannot 

perfomi satisfactorily, even if he is told what to do 

Clutching and shifting an automobile with a manual- 
transmission 

Precision measurement with a micrdfeeter 
Discriminatlda/ behavior-recognizing differences^ between 
objects, indications, or examples so' that different responses 
can be made to them' 

Aircraft, tank, or automobile identification 

Selecting ^one ^pswer, example or obj^t (solder joint, 
. for example) as the "best" 6r "correct" one, according 

to certai/1 standards. 
Complex perceptual-motor behavior 

Driving a car 

Flying an airplane ^ \ 

Problem-solving-recall and application of^ concepts and 
principles 

Trouble^ooting complex equipment without pro- 
ceduralized methods and job aids . < ■ . 
.••Planning the>worK of a group of people, and assigning 
tasks ' ' 
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Tracking and aimin/ 

Radar tracking 

Aipning a gun 
Searching and scanning 

Aircraft detection 

Aerial observation 
••^anning-quick*search» subordinate 'to some other task, 

sufh as scanning instrument panel while driving 
Discrete or continuous performance 

Discrete— step-by-step performance", with individual steps 

being clearly separate elements of the performance . * 
Operating control panels in missile systems 

•## Assembly and disassembly of equipment v 

Continuous-cannot be divided into clearly 'separate 

.elements; continuing performance, usually guided and 

modulated by feedback 

Aligmng^T adjusting electronic equipment 
Riding a bicycle 
Noise-filtering-detecting cues or symptoms 'among a 
background of extraneous stimulation 

Listening to an engine to diagnose malfunctions \^ ,( 

Detection ot targets on radar scope \ o 

Skilled actions-activities that the uatrained person cannot 
perform satisfactorily, even if he is told what to do * -^4*^ 
••Clutching and shifjing an automobile with a "manual 

transmission ' ^ 

•• Precision measurement with a micrometer 
Discrimination behavior-recognizingf differences, between 
objects; indications, or examples* so that different responses 
" can be made to them . ^ ^ ^ 

— Aircraft, tank, or automobile /dehtification 

•• Sefecting one, ^nswer^ example or object (solder, joint, 
' for exanrtple)" as the "best" or "correct", one; according 

- * to certain standards * 
Complex perceptual-motor behavior^ 
•• Di-iving a car ' . - 
•• Flying an aicptane* > 

Problem-soPving-recall and application of concepts and 
p^rinciples 

••'Troubleshooting , complex equipment without pi;o- 
; * ceduralized methods apd jbb aids 
•• Planning thip work of a group of people ^and 
assigning tasks\ * < 
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TRAININGS APPROACH 



• is this trainii^ approiich suitable; considering the degree of 
proficiency required in the various tasks or performances that 
,thet$tudent will be expMted to accomplish to satisfy the 
training objectives? The foflowthg outline describes the kifids 
and levels of proficiency that mighrbe required: 

• Task performance standards 

_ ?> 

Extremely limited^an do sihnple parts of the tasks buj 
p needs to be told or shown how to do most of^thetask 

Partiairy proficient-can do most parts of the tasks.buf 
needs help on the hardest parts of thctasks ^ 
^ ••'Competent -can do all parts of the tasks and needs only 
be spot-checked 
•• Highly prpfic lent -can do complete tasks quickly and^ 
accurately and can tell or show others how to do 
the tasks 

• ' Task knowledge standards - , , , 

•• Nomenclature only-can name parts, tools, and simple 
^ facts about the tasks-. 

•• f^rpcedures-can name the' steps ir> ^ing'the tasks and 

tell how each is done ' " . 

••Operating principles-rcan explairi why and* when tasks 
• rhust be done and why each ste0 of a task is needed 
. ••Complete theory-can- predict, identify/ and /resolve 
' problems about .the tasks . ' ^ 

• General knowledge standards 

•• Facts-can cite basic fact'f about the subject * 
•• Principles-can explain relationships among basic facts 

^^^^ general principle^ about the subject 
•• Analysis-can analyze facts and principles and draw 
conclusions about the Subject ^- ^ 
* • •• Evaluation-rcan evaluate conditions and make proper 

decisions about the subject 

J?' . < ' 

C. Implications (or requirements) of training approach for organic 
^ zatron of training content. 

1. Dbes this training approach provide a basis for dividing the 
training content into blocks or modules? 



''.'jiNo 
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TRAINING SETTING 



Notes 



What kinds and levels of proficiency are required of students 
in performing the various tables they must do to satisfy the 
training objectives? The following outline describes the kinds 
and levels of i^oficij^ncy t|jiatjnijdh r^uired: 
• Task performance standards 

Extremely limited-can do. simple parts of the tasks but 
needs to be told or shown how to do most of the task 
- Partially proficient-can do most parts of the tasks but 
needs help on the hardest parts of the tasks" 

• Competent-can do-all parts of the tasks and needs only 
be spotrchecked • 

•• Highly proficient-can do compjete tasks quickly and 
accurately and 'cah tell or show others^fifc>w to do'^e 
tasks 

f Task knowledge standards 

Nomenclature only-can name parts, tools; and simple 
facts .about the tasks / >j 

Procedures-can name Xh& steps! in doir>g the tasks and 
tell how each is done ^ 
••Operating principles-can . explain why and when-tasks 

must be done and why each step of a task is needed 
•• Conr\|jfctete. theory-can predict, identify, and resolve 
* problems about th^ tasks 

• General knowledge standards j 

•• Facts-can cite basic facts about the subject , 

•• Principles— can explain relationships among basic facts 

* and state general i^rinciples about the subject 

•• Analysis-can analyze facts and principles and draw 

"conclusions about the subject ^ 
•• Evaluation-can evaluate, conditions efnd make proper 
decisions about the subject ) 



Favors in the training setting that influence the organization 
of training content. ' ^ • . 

1. Are there, ' within the training content itself, natural 
divisions that should. be considered when dividing the train- 
" ing content into blocks or modules? Are some parts of the 
training content prerequisite* to other parts? 




er|c 
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TRAINING APPROACH 



' 2. Does the training approach have any Implications for the 
sequencing of training content? 



D. What kinds of Instructional activities are implied*^ by the train- 
ing approach? The following list gives several examples of, 
kinds.of instructional activities (others shouW be added if they 
are ne^ed):, , % ' * ^ 



Presentation of knowledge 
Practice of knowlklge 
Practice of performance 



• Demonstration 



Provision 9f feedback, or krrovvledge of results, to students 
Provision of individual, tutorial assistance to students 
Evaluation, op training quality coQtroI ' 



What 'effect does this training approach have on th^ effort 
necessary to make changes in the training content? In answer- 
ingf^this question it may be useful to consider the kinds of 
unhs or modules of content involved in thjs training approach, 
and the formats or media to be used. * ' ' 




INSTRUCTION/^L PERSONNEL 

' A, What? roles do instructors play in this trainitig approach?* The 
following list describes some |»o$sible roles for instructors; 
others sheukJ be added if necessary: 

• Presentatiorr of instruction (lecturing, demonstrating)' 

• Evaluation of student perfornriance (proficiency testing) . ' 

• ^'Monitoring student performance (and intervening when 

necessary) 




TRAINING JETTING 




2. Are^ there other factors , in the training setting that should 
be considered when .dividing thte training content into 
blocks or modules and deciding on the* sequence of training 
activities? Some of^these factors might be: 
• • AvailabilitV or arrangement of physical facilities, such as 

operational or tralhing^equipment 
- • The need for a flexible sequence. of^ training activities, in 
order* to, be able to Wdrk around* bad weather or 
equipment failgres 
• ComrrYand policies . ^ 

D. What kinds of ^s^uctiora^^ivities are impMed by the train- 
, ing content (ancKMssibty by Mother aspects of the training 
setting)? Yhe following^li^ gives several examples^^f kinds of 
instructional activities (others should^Be^ added if. they are 



needed): 
i 



If 



Presentation of knowledge 
Practice of knowl^dge| 
Practice of performance 
Demonsfratipn / u 

Provision of feedback, or knowledge of rlpsults, to students 
Provision of individual,. tutorial assistance |o students . 



- Evaluation, or training quality control 



E. What are the frequency and extent of training content changes 
that may be expected in this training setting?' What are the 
.policies regarding changes in training content in this train* 
ing setting? - '. ^ ^ 




INSTRUIJJIO^AL PERSONNEL 



Does the training content, or any other aspect of the training 
setting, have implications for the rples to be played .by instruc- 
tors? The following list describes 3ome possible rotes for 
instructors; others should be added if necessary: 

• Presentation of instruction (lecturing, demonstrating) ' ^ 

• Evaluation of student performance (profjcrency testing) 

• Monitoring student performance (and Intervening vyhen 
necessary) 



ERLC 
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• Managing the Instructional system /(assigning students to 
training activities, mooitoring training equipment .utiliza- 

♦ tion,etc.) . 

- • Planning and* developing' instruction USD activities) 

• Conducthig discussions 

• Lea(jlng^ student activities 

B. Are auxiliary instructional personnel needed with fliis training 
approach? The following ^lisf describes some possible kinds of 
' auxiliary^ instructional peteannel; other kinds shoukJ, be added 
if needed:^ \ • - *• 

• Proctors (monitoring stiJdent activities but -not intervening) 

• Administrative clerJ<s-^recbrding and processing data) 
" ^ ^ Tr^iniiuj equipment /l^eratbrs and repairmen ^ 

• 'Comptiter progrannmers \ \ ' 

• ' " M \ ' 

* C, What special skHls are needed by instructors using this training 
approach? Tfie following jist describes some possible kinds of 
s^jeciaf skills that 'fn«jht.|be required; other kinds shoukJ be 
•adc|ed if needed}, ♦ . ^ ' . > 

^ • Proficiency in the subject matte/ students arejto le^arn^ 

• Mafnaging instructor-student relationships**^c1assroorTi 
, managennent skills, reinforcement techniques, counselling 

•\t •techniques, etc.) 
• ' ^N^ * Analyzing and critiquing student performance 



Relevant field experience 

Proficiency in instructional system development activities 
Operation of audio-visual equipment ' . 
^y^, • Computer operation or programming ^ 
, • Writing skilly ^ ■ \ 

Proficiency in evaluating student performance 
Knowl^ge of the relevanfadministrative system 
Operation and/or maintenance oif operational equipment 
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Managing the instructional system (assigning students to 
training activities, hionitoring* training equipment utili< 
zation, etcv) ' 

Planning and developing instruction (ISD activities) 
Conducting discussions ) 
Leading student activities ^ 



4 Notes' 



B. oAref;auxiliary instructional personnel available in thi$^ tj:ahiing_ 
setting? 'The following list describes some possible kinds of 
auxiliary instructional personnel; othef kinds should^be added 
if needed: 

' • Proctors (monitoring student activities but not intervening) 

• Administrative clerks (recording and processing data), 

• Training equipment operators and repairmen 
I • Computer programmers 

.• -* • ■ ' . " 




What s|>ecial skills are possessed by the instructors available or 
obtainable In this training setting? The fbllowing list describes 
some special sk^ls that might be available; other kinds should 
''be added if needed; * y 

Proficiency in the subject-matter students are to' learn 
Managing instruator-student relationships (classroom 
management skills, reinforcement technlqueSr counselling 
techniques, etc.) ^ 

Analyzing and critiquing student performance ^ 
Re[eyarit field experience 

Proficiency in instructional system development activities ' 
bperation-^f^diO'Visual equipment 

Computer operation^pr programming • >_^x> / 

Writing skills . ^ "'^-v " -.-^-^^ 

Proficiency ir\ evaluating student^fJeri.ormante ' ' 
Knowfedge of the-felfya^jtai^i^.^^^^ 
Operatio'n an37br- nfiainte^~^^ 
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INING APPROACH. 



J 



lnstrtictiQiiM¥-p«f$o^^^ 



1. Consjdermg .the- 'relevant Trained. Personnel Requirement 
(TPRf ai^/the skiirs-'of thejn^ructdrs available, will this 

•training' approach require more or fewer Instructors than : ^ ^ — 

W(^ki otherwise be needed?"Dods this draining ajppr^a^^ '"^'^^ 

require wme minkT\um.\,t?umber of instructors tO' '6e , -^zPr^ 
\ ffiaslble?r ' » ^' ' 

2. If the 'number of students is increased or decreased sub- 
/' stanjially, .will additional' or ^fewer- instructors "be required 

foK this iriaining 'approach? If so, in. what ratio to the 
, increased or decrea^ /lumber of students? 



3: If .^ditional instructors wUI be nefeded for implementing 
'this training apprpach,. have allowances been made in 
planning for the leadytime' necessary to obtain these 
instructors'?. 

4: is special or .idditioTial tra)ning.);equired for instructors to 
use this, traimng ■^prbach^'The' resistance to change found 
in almost alK ofgafrfizations may^fa« a special problem in 
implementing^a rj^ training approach^ • . * . ' 

5. Dofe thisyaj&fng appfbach have any. special. implications 
. for/ evdiuatipg'* instructors? Are some*, instructor per- 
fomiance5yp[arti,bufarly critical in this training approach? 
^ Are in<lij^tdrs.of instructor performance a\fei!able' with this 
trainiogapproach? - 

STUDENT CHARACTERISTICS 



r • " • . • ' • 



•11 



\ 



'■ft. 




1. Is this training approadi feasible for the numbers of. 
students that must be trained? Does this training approach. 

^ require a minimum number of isfudents to be feasible? 

: : ' I " 

2. Does this:traimng approach deal with students in groups, or 
can it accommodate • a rhoret: or less continual flow lof 

: students into ^tfie training course? » 

3. Caa this training -approach, handle marked fluctuations in 
the numbers of studehts entering training? 




\ 



J* 



/ . 



X 



/ 

'.9 



^ D. Instructjpnar^e^ / * 1 

r'^mthis trainifig setting^J^vTmany instructSps arejnoiri^ly / 
authofized for tb^-fexpecHd numbers of-.^tudq;nts In this* 
"course or^porflon of a course? , i j - 




2i If the.nunfiber of students is increased or /decreased sub- . 
' stantially, will the' authorized numoer of- instructors be- 
' adjustejd accordingly in this training .setting? jf 'so, in whW 
ratio^to'thl i^icreased or^decreased;Humbec' of fsfu dents? 

3^ In this training sett 1 ng,^vyhaf is./t he lead .time- involy.^^ in 
' obtaining additional instructors^' / ' '^-/'^^/^ 



4' 



^ 4. Are facilitiies or resources aydlj^ble in this training 5%incf^so 
that any Vfequlrenients'. fpr^ special or addijional^ti-ainlng of 



instructors \an'be met?* V 



5. What ire ,the \poli<}ie;5/^e^rding instructor evaluation in thi/- 
training sfetting? / . A ' v ' v 



3 -i^/' 



> ^ 



. STUDENT CHARi^VC^i^lSTICS 

A. Numbers of/stuaents^ 

1. 'Accorclrng" t6* the relevant y^rained Personnel Requirement \ 
/ (JPRL Hojy many rt<idepts per week, month, or- year are ^ ^ 
\^ ^' !fequired/fo. b^* trained^^ the 'course or part of i course ^ 

* V concerned? V ' ^' " 



I;- 



is, 'training i^3$ting, are , stUdehts ^availabh 
ig in grouj 
^continual, f loW? 

. >poes the/numb 
^ fluctuate sharply?' 



2, In Ayis,%aihmg are , students ^avai I abfe to begif> 
training in groyjis at specified intervals, or in a more or less 

^cqhti 

3. *Does the/number of -students . avajlable* to enter trairt}ng 



Hotss 

I. 




^ m-^^^s^Ktr^-^ — — * 



> * - ^ 


— 




J 


TRAIN INd APPROACH ^ .1 ' i 








' f 


i 


\\ % ' 
' Notes, \\ 




\ , ^- this;ytraini'ng'. approach utilize a basic instructional 
^roup oivfelatively fixed size (e.g.r classroom, work, or 
• laboratOQf^group), so that there is a relatively fixed incj-e- 
*T^ent bV^\W)ich the number of students in training can be 
• increas^vi^Qii. decreased? 


( 

j 


■i 

'■I ■ !]• • 

■\ n^. 




^ % . ' 1 * • 

B. Relationship! qf training approach to student aptitude levels; 




1\ 




i ' , • * • ! ^ ' 1 • ^ ' 

\ ' V%i^ ^^'^ 'tr'^ming approach especially statable for students 
V jW'^'" aVp^hicular range of the relevant aptitudes-high, 
^ ^ - . ' > • 4 J^w,: or middle-or is it useful for students of alhapti- 
^^elevelsj . ! ' . - \ 






' ' \ ' 

** \ 


^ . ' 2. !\f^\^ training &^^roach suitable for students selected fpr' 
^'Wl speciaraptftdides other than the four standard Air 
^ - . , '\ Por^e aptitude areas (Administrative, Electronics, General, 
and^Mechanical), such as athletic, verbal, clerical, of space 
^ ' . gelations? - ^ ^ 

. ' " < y ^ ' • • ' . ' ' . 








^* %)ecial skills or other characteristics required of students by 
^ thif training approach. ^ . 




• 




A • ]• this, training approach assume that entering students 
f ' ^ . ' will already have been trained in any Special skills? 






♦ 


2. Must students have some minimum reading level for this 
. _ trafining approach to be feasible? 








3. Does this training approach require that , students have 
, , especially good vision, hearing, or other senses? Wha't about 
^dents with poor sensory acuity, especially thpse who are 
\ '^^more or less color-blind? 


> 






^ " 4- Po^ this training approach have any implications or 
* ' ' requirements for other student characteristics; such as * 

^ physical stamina, fear of heights, volunteer vs. non- 
>^ volunteer. Human Reliability, speech impediments, manual 
. - dex'terUy, appearance and bearing, etc.? 






> " 


^ ^ J. . 5. Can this training approach accommodate students who are 
unusually strong (or weak), or large (or small)? 


- 






_\ . . \ <^ - - ■ 
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4. Do student input rates, or the charaQteri^tics, 6f the 
physical facilities in this training setting have impMcations 
for the size of the basic instructional group*' (e.g., classroom, 
work, or laboratory group), and in turn, for the size ot^ 
increases^ or decreases of the 'nQmber of students 
in training? ' . ^ 

B. Aptitude levels of students in. this training setting. • 

» 

' 1. Are. the students available or assigned to this training 
setting selected so that they fall withjji^a--paffic^ range 
on the relevant aptitudes^high, middle, or low— or are they 
' of all leveft of aptitude? 

* 2. Are, the students available or assigned to, this training 
setting selected for any special aptitudes other than l^ie 
^ four standard Air Force Aptitude areas (Administrative, 
Electronics, General, and Mechanical), such as athletic, 
verba), clerical or space relations?' ^ 

C. Speciaf skills or characteristics possessed by students in this 

-. . . » - y" 

training setting. 

1. Have stl^mts in this training setting already been trained 

in any special skijls? - ^ 

— ■ $ 

2. What is the reading level of students in this training setting? 



3. Have students in this training settifig been selected for 
especially good vision, hearing, or other sensory acuities?. 
Or, (lo some students have poor sensory acuity, such as 
defective color vision? 

4« Do the students in this training setting* need to (\ave any 
other characteristics that might be relevant, such as physical 
stamina,- lack of^^ar of heights, volunteer vs. nonvolunteer. 
Human Reliability, no speech impediments, manual dex- 

^ tenity, particularly good appearance and\bearing, etc.? 

5. Are the students in this. training setting unusually strong (or 
weak), or large (or small)? 
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TRAINING APPROACH 




Does this training approach have any implications for the sex 
of students, or for whether students are dealt with in sexually 
mixed or segregated groups? Factors that might be involved 
here include: different equipment or clothing requirements for 
women from inen, or from those normally used by women; 
latrine iacilittes; quarters; etc. ^ 



'E. Does th^s training approach Jiave any implications concerning 
whether foreign^ students, or students from other services are 
involved in the training? 

F, Does this training approach have any provisions for dealing 
with students who may be very poorly motivated because of 
' malassignment or for other reasons? 



G. Implications of training approach for student nrufna^enient. 

1. Will it make any difference in using this training" approach 
whether the course of instruction is of fixed or variable 
length for different students? 

2. If this training approach is used, will information be 
available from which to predict students' dates of avail- 
ability for assignment (graduation), if a* variable length 
course of instruction is used? ^ ' 

3. ^ Will use of this training approach make it necessary {or 

possible) for students to have periods of time befor.e) 
during,„or aftecthe^iinnain body of training when they, will 
not be occupied with training*activities?'lf so; and students* 
.are not required to peHprm details; or other^activitfes not 
related to*training, does this trainirfg approach 'suggest con- 
structive uses for this time?, 

4. Can this training approach accommodate' student a^nces 
fron;i training activities, arid the resulting* need^ to m^ake up 
.missed work? 



D. Are the students in this trainiog setting male or female, or 
both? If both sexes/are represented, are there any policies or 
implications from tpe training setting as to whether groups of 
students* shad be -sexually mixed or segregated? Factors that 
might be involved here include: different equipment or 
clothing requirements for women from m^n, or from those 
normally used by womer^ latrine facilities; quarters; etc. 

E. Are there foreign students, 'or students from other services 
represented among the students in this training setting? 



F. Is it likely in this training setting that any significant number 
of students will be encountered who are very poorly motivated 
because of malassignment or for other reasons? Are there 
policies which indicate how such students are to be dealt with? 

G. Policies affecting student management in thNs training setting. ' 

1. Does the training setting, require a fixed length for Jhe 
course of t instruction, or is a course of instruction of 
.'variable lengths for different students permitted? 

2. What, requirements for advance information on students' 
dates of availability for assignment (graduation) does this 
training setting impose, if a variable length course of 
instruction is used? 

3. Are students in this training^setting required to perform 
extra duties, details, etc., "ot^lBkl to training, or is it 
important for them to finish ti'aimng as soon as possible? Is 
it possible to offer incentives to students who fi'ni-sh train- 

^ ing early? ^ . % r 



4. How. much may students^^xpected to' be absent from 



training activities in this training setting? 
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Chapter 5 
DISCUSSION 0J= THE MODEL 



: During- the development of the model, a nUmber of difficulties and tempting 
p div^ions were encountered. Th^ are discussed in the following section., Also, ^ a later 
section of this chapter, the relationships of this modeUto several major/svstems and 
projects involving Air Force technical training are discussed . ' / * " * * ^ ^ 



COMMENTS ON THE MODEL . . 

Trying to capture as many as possible of the dgnificant factors in the training 
universe within .the two' categories, training approaches and trying settings^' has been, 
difficult, A sustained effort was mode, in developing ^the model^ \o k,eep its purpose in a 
"ominaijt, governing position. In? shaping the questions for thei model so that they tap 
ignificant factors in the trailing situation, there has been a sitrong tendency for some 
elements ir^ the training setting-particularly training content-^o assume the status of 
additional, .independent categories. In fact, a description of the training universe merely 
for the sake of description m'ight have led to several m^or elements having coordinate 
st^tus-^trainiAg approach^, students, instructorsl; training content, physical facilities of 
* the training establishment, and' so forth. Howeve/,* because the purpose of the. model is to 
evaluate the potential suitability and usefubi^ss of training approach^ in particular 
Mining settings, the model has beeri cast in th^fonn of t^ese two categories. ~ \ 
^ In the course of developing the model, there has also been -a tendency to think qf 
the training' apwoach as generating requirements in the training situation, and to feel that 
an examination^ - the training setting* can show whether, or to what extent, these 
requirements may\^e satisfied. It was found, however, that this cOnceptualizktion of, 
requirements vs. resdi^ces with which to satisfy them was not particularly useful or valid, 
because requirem^ents^o arose out of eleta^ m the training setting, particularly the 
training content and thi^olicies of the traifuflg agency or command. This ;way of looking 
at the problem wa& set^ aside in fayor of the training approach/training setting 
conceptu^alization. \ 

In developing the, partsVo^the model dealing with instructional personnel, account 
w& taken of the wor^ of Mdching, anci Whitmore' (1973) on the requirements for 
effective performance by Army Ninstructors <in classroom teaching. Their, model of the 
functions of a master instructor covers a limited area of perfonnapce, and accordingly is 
much more detai^-in the area of i^tructor performance than the model described Jn 
this reportj> However, the instructional p^jsofenel sections of ttiis model are designed to be 
^consistent with the MelcHing and. Whitmore^odel^ ^ / ' - 

The classification o>the kinds of perfonnancfes required;' <if students by the tmning 
objectives, under "Characteristics of Training^Coht^nfyn the mddel, has been a difficult 
.area, to deal with. Clearly, the kinds of performances expected of students after training ' 
should determine the kinds of ^activities in whicK they engage during training. The nature 
of these le'^ming activities is important in dietermining-whether training approaches (i.e., 
any methods, techniques, devices, or systems' being* considered foir use iniraining) are 
appropriate and effective.'It also has import^t implications for many otherjjfelements of 



thd'^braining setting, such as;the amount and kind of space reiqtuired, the skills required of 
instructors, and the aptitudes and previous training required of students. ^ - 

. However,- in the MODIA system (Britz, 1972, p. 5), any classification of the training 
content is strictly avoided. Individuals responding to the MODIA cumculum.^ analysis 
questjonnaire* must infer from the nature of the training content with which -they are 
dealing, ^tQ make decisions about whether the training will' be in a classroom, whether 
special eqm^ent is needed, whether individual or inter^clSve skills are involved, whether 
this learning event requires visual means . (besides print), sourjfi, or motiorf, and so forth. 
In general, the nature of the activities occurring in a **leaming event" is not explicitly, 
considered, in MODfA, and the instructional designer who responcls to the curriculum 
analysis questionnaire is, required to examine these activities and make inferences from 
them with no guidance frorri any conceptualization of the kinds of student performances 
being dealt with. * / • ^ * ^ ' * 

In the model described in this report, an attempt was made to provide analysts with 
a frame of reference for the performances requir^il of students, to aid tHem i n inferr ing 
from these 'ngrformances* the appropriateness or probable effectiveness of "the trainmg 
approaches b^g considered. Jn developing the classification ofJhe kinds of perforpiance 
required of students* in the "Characteristics of Training Content" section of the model, 
several previous efforts at classifying human performance were studied, primarily those in ' 
Bloom (1956), Gagne (1970), and Fleishman and^ Stephenson (1970).^ The systematic 
appro'ach to training of Smith (1971) was alsd^onsulted. 

It was concluded that comprehensive classificatiqns of* human perfomxance have 
been difficult to develop and are of limited usefulness. In developing <the classification of 
ihe kinds of performances required of students for this model,«considerable use wfas qaade 
of Gagne's '.(1970) eight types of learning an& of Bloom'| Taxonomy of Educational 
Objeclives (1956), However, the attempt* was made to describe the lands of performances 
listed in the classification in terms that were more relevant. to- Air Fojpce-technical'tramihg 
content thaji the descriptions of performances offered by Gagne antrBloom. t 

Thia. cla^altq^ti^ redbired of smdents has a good deal 

in^ common- vnth. the types- of learning discussed in^ 50-2jjDepartment of the Air 
Force, 1970, pp^^ 5-12* 5-13), "and in. AFP 50-58 (Departtaent-^f the Air Force, 1973, 
Chapters), whicii were undoubtedly derived from much the same iources. It is;- hot 
considered crucial whether the classification described ^bo^e, or one of tl^ose described in 
AFM 50-2 pr AFP 50-58; is used in this model. Tt is considered important^tiiat the 
instructional designer * be given spme guidlSice in deriving the implications" of ty pe of 
* training content for training approaches. ' ' ^ 

The kind of performance labeled **recall and japplication of facts" is the same as the 
behavior called "ruieJearriing" by Gagne (1970). In this kind, of behavior, concepts and 
their relationships (rufes) must have been leame4, and their applicability recognized, in 
order for the behavior to be possible* in a specific situation. Xhus^ to follow .the rule 
**alwayS' pour acid into water, and not watet into acid, when mixing the two substances," 
the student fnust have learned the concepts *'acid" and -^Vater" and the relationships 
**pouring" and "mixing." Or» to follow the rule or prescription •^set the voltage afll5*, 
± 5,r the student must have learned the concepts^ **voltage" (at; least to the extent of 
' knowing whidh control to operate), ^15, ± 5" (at least to €he extent of knowing.which 
indicator to observe and the range denoted), and the relationship "to ^et.?'."^ - 

It. should also be noted that ^^discrimination behavior" is intended to cover ev^alua- 
tion and recognftion behaviors,, suice an awareness of differences between stimuli (objects; 



^.This project extended ov6r several years and resulted in numerous technical r4>orts. The specific 
report cited was. chosen biecause it -gives a good .overview of the project and lists the project 'Reports. 



, indications, or examples) and the use of some standard or rule to select differential 
responses to the stimuli are. common to ail such b^havjor. Thus, the student may 
_ recognize that traffic lights are of different colors (or that the red light is on top, and the 
^een-4igbt-is the bottom one) and stop if the red light is illuminated or proceed if the 
rgieen hght is illuminated. Or, Ihe student may recognize differences among a set of radio 
of mtercom messages and choose one to label as, most appropriate or correct according to 
T a specified rule or standard. > • . . 

EinaUy, a performance .may involve more than one dement of this classification 
n , .„ P'°'=®*^"^^s often discrete^ performances and continuous performances are 
usually skilled actions, of which an example might be tracking performance. Thus, a radar 
operators job may^volve several of these elements:' fixed serial procedures in energizing 
the equipment; noise-filtering, in observing the radar presentation; "and continuous per- 
formance m tracking. The purpdse of such a classification is to make more obvious the 
different aspects of a jpb or eyen a specific performance within a job,' so that suitable 
. activities may b^^lectfed or devised for students to engage in during training 

Some thought was given to casting the model in the form of two coordinaied 
checklists by developing comprehensive sets of answers to the questions, so that using the 
model would involve responding tb a series of multiple-choice questions. However, it was 
felt that, at the present stage of model development, it would be difficult to develop sets 
of choices comprehensive enough to adequately clover ^he great variety of oossible 
answers to the qa^tions^asked about training approaclles ,ancl settings. (For example, how 
. .many and what kinds of speM skills might conceivably be required .cif students as 
prerequisites for entering manj/ different coUrses of study?) Comprefiensive tabulation of 
a long list of possibilities here' would bV^ery difficult. Therefore, it was decided for the 
, present at least, to cast the m^el in the move general forrii of open-ended questions, and 
to rely on the analj^st* using it to generate, in response to > the questions, the specific 
characteristics 'or- attributes appropriate to a particular training anbroach and 
tramin g setting. / ** - , 

.The moBel in ils,pres^t-s|orm oftwo coordinat.ed series of 6pen-€ndec( questions is 
not immediately amenable^to computerization. After the model as it now stands has been' 
JgSlfed for Its adMuacy an(J.. usefulness and revised as necessary, and if if appears tliat a 
substantial vplumeXof usage can be expected, it shiJuld be^tossible to modify it for use 
with "^a computer. \ / ' \i »' I • * 

- One possible ap^ach to c<vnputerizing the model 'wttild b^to cast it in the form 
of two coordiifated ch^klists, as has been discussed. It could b§ seliu^'' to operate in an ' 
mteractive fashion similak to that planned for the MODIA system for tlesigning instruc- 
tional programs (CarpenteMl972). Computer software might be developed for presenting 
• the questions and. sets of answ.ers to the analyst at., a computer tertninal, recording the 
answer.'choices, and summarising the degree of "fit'' between the training approach and" 
the trammg settmg.,A sut)gtantial effort would be required' to develop the softwkre 
necessary for comp^fiterizing th\ model, and p is felt" that' i{s' adequacy should be 
evMuated and <es.timates of its likely ^olifme of usage obtained before making a decisidm 
on whether to comiiuterize the mode'^ ^ 

RELATIONSHIP ,(b^l= MODEL TO ISP AIS, AND MODIA ' 

J ' ^ ' • . 

A number df major programs a^e in varioiis .ptages.of implementation in the uS Air 

/'Force technical training environment. Most important of these are the '^Instruetional 

System^ Development JISD>. effort (J?eparlment of the Air 5'orce, 1970 1973) the 

Advanced Insti^ictional System (AIS) effort (Rbckway anrf-'^Yasutake, 1973), and the 

.MODIA system (.Carpenter, 19^72;. Carpenter, and Homer, 1972; Bretz, 1972;\and 
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Petruschell and Carpenter, 1972). This section will discuss the relationsliip of the model 
presented in this report to these major- programs or systems. Generally, it is expected that 
this model should be useful within the frameworks of all of these programs, or systems. 

The ISD effort is a laj^e. Air Force-wide program in^ which the m^'or training 
innovations of the 1950s and 1960s are being implemented'. The model for matching 
training approaches with training settings should be^usfeful primarily in connection with 
the activities of Step 4 of the ISD process— Plan, Develop, and Validate Instruction. It is 
not expected that the model would .be used formally for every decision made in the 
cqurse of Step 4 activities in the ISD process, although many of the factors in the model 
might be informally weighed ill making these decisions. However, whenever apy substan- 
tial decisions concerning < instructional methods, techniques, media,^ pr devices are to be 
made, the ^podel should be useful. It ^ould probably be useful also^n making decisions 
concerning testing methods a|id devices in Step 3 of the ISD process. 

It should be eipphasiz^ that the model is designed for* a much broader scope of ^ 
usefulness than the relatively narrow area of instructiohaymedia selection. The applica- 
tion .of "the model during development to some basic instructional system techniques, 
such as peer instruction and mastery testing, for example, and to sophisticated instruc- 
tional devices such ^ the Lincoln Training System, should demonstrate the wide appl^ 
cability of the modelV^ • ' . ^ ^ 

The AIS is a computer-based system for the administration and management of 
individualized technical training on a large scale, presently Ibeing developed at Lowry Air 
Force Base. The system is to. encompass the .whole range of instructionaf activities from 
the development of; instructional niaterials and strategies to tihe administration and 
evaluation of instruction involving a variety of media and methods. After the develop- 
ment and demonstration of the system on three courses at Lowry' Air Force Base, it is 
likely~ that it will be expanded and &istalled at other locations so that a substantial part, 
perhaps most,* of Air Force technical training may be carried out within such systems 
some y^ears hence. . ^ . , / 

Jn terms of tlie defmijions set out^ early in this report, the AIS, along with a given 
body of training content, may be considered a t&nings setting. Because of Its probable 
importance in Air ^Force technical training in the near /future, it is likely'to be the single 
ra^st important training setting to which the model described in this report nufght 
be applied. • 

Within th$ general framework of .the AIS, as it is u^ for ^additional courses and at 
additional locations, there will be a lai^e nuftiber of decisions to be made concerning 
wh^t this ,report has called instructional approaches; strategies and methods of instruc- 
tion, instruction^ devices, job md's, and so on. The general model developed in this 
project could, be adapted for us%^ in the AIS by describing the main characteristics of the 
AIS as a training setting. Then the characteristics of a particular training content could be 
added, and one would have a very substantial set of requirements and standards,, against 
which to- evaluate any trainings approach which one might wish to consider. Thus the 
model de?cril3ed in this repoit is seen as quite capable of being incorporated into the AIS 
a$-an aid in its expansion and installation at other locations. 

The'MODIA^ system has be^n developed , for the U.S. Air Force by th^^ Rand 
Corporation (in a .project erititled ^'Analysis of Systenjs for Air Force Education and 
Training"). NTODIA (A Method of Designing Instructional Altematiyei^is a compre- 
heilsive methodology for-derigning instriictional' programs. ^ - * ' 

'The greatest strength of the MODI A system is its capabilities, for spelling ou^in 
detail the consequence and costs of a given set .of decisions concerning an instructiotl^ 
program. Al^cT, in its computerized form, it will make possible the ready comparison of 
the consequences a^d costs of alternative decision^ concerning an instructional program. 



However, the MODIA system has been designed to be almost universally applicablei 
and this has led to the use of a highly generalized and somewhttt abstr^c^ terminology. It 
is likely that this .terminology will be confusing-t6 many .Air Fdrce training personnel 
who have become thorcfughly familiar with Air Force, and particularly. Air Training 
Coimnand concepts and tegulations. Further, the MODIA system is relatively weak in the 
guidance it offers/tb ins^ctional planners to help them make- the majof, early decisions 

. in designing an instructional- program-. The MODIA techniques for ijringing to bear on.,the 
mstructional design process the poUcies and constraints of the training command or 
agency and the impUcations of the particular training content involved depend oh highly ^ 
detailed, branching c^uestionnaires. The detailed choices posed in. these questionnaires are 
inevitably highljr structured and tend to«liffiSt the conceptuaUzatiop of the instQictional 
process. In addition^th&y ar^ often highly abstract. In short, it is argued that in the area 
of major decisions concerning training approaches which must fee made early in the 
instructionrf.design process, the MODIA system is limited in its scope and flexibility, and 
in the guidance it offers to instruptiortal planners. In an Earlier pah; of this Chapter, this 
point has -already been made in more detail in the discussion of the. impUcations of ^;he ' 

-kinds of performances required, of students (i.e., training content)'for decisions regarding 
training approaches. , 

The model described in .this report, by virtue of it§. flexible, open-ended nature, and 
the fact .that it concentrates entirely on the implication^ of all aspects of th? training 
setting for these major, early decisions regarding training approaches, should handle-' ^is • 
part of the instructional de?ign process more adequately than"the MOpiA system, does. 
Once these major, early decisions regarding training approaches" have been made, the 
MODIA system for sp^elling out in detail their cbhsequences and c^ts should' te 
quite useful. . , 



^ Chapter 6 ^ 

APPUCATtONS OF JHE MODEL 

' ' \ . . ' 

■V 

The current version of ^the .model for matching training approaches with training 
settings has been applied to 'a training approach and taa training setting. The application 
to thq training approach was made l3y the project principal investigator and author of this 
report, while ihe applicatjioii to tlje training setting was made by- the other member of 
the research team that visited the Tedinical Training Centers, as described in Chapter 3. 




APPLICATION TO TRAINING APPROACH 

«. u. • • (f * 

^ The training approach to which the model was applied was the peer instruction 
systelh (Weingarten, Hurigerland, arid Brennan, 1972).fln this case, both the peer instruc; 
tion aad the •mastery testing training approaches, as described in Chapter 2 o'f this^-report, 
are inclu^dM, since operational peeitMnstructioAsystems have included both^features. 

' In^'applying tjie^^pioflel to tfiTe peer instnrcti^n system, it was found ihat, in almost 
all paSes, thev qil^iris on the • training apptpacti side of the model cpuH be answered 

I quite • readily /feomewhat'^general answers had to bef^iven to some questions, and in a few 
cases information £fom a specific training setting woi|ld havq been required to answer^he 
question. This application is at the general, preliminary level described in the introducti?^ 
to the model in Chapter 4, for which tKe^^odel appears quite feasible. This application 
of the model td the peer instruction training approach is . presented in Appendix A to 
this report. * ■ / . * . ( ; 

APPLICATION TO Tf^AINING SETTING * 

The training netting to which ' the model was applied was that jof Course 
' No. 3ABR81230, « Law Enforcement Sp^ecialist, as taught at Lacklarid Air Force Base, 
fifexas. The information available on ^hich to base this application of the m^el consisted 
of the Course' Chart ^id the Plan of Instruction (POI) for the Qourse, plus the general 
information gained during the v^it of the reseafch team to the School^ of Applied 
Aefospace Sciences at Lackland Air Forcfe Base. * * t * > 

It was^ound that, while a number of questions on^the training^ setting side of the 
model could be answered, many critical ones could- not be ans^Q|Bd with the information 
avaUable. For examt)le, the question on "Objectives" probes in ageneraF fashion for the 
hopes knd aspiratioi^^^jt persons working in the training setting whoi are responsible for 
its effective apd efficient cjperation, and for problems that may exist\ within the training 
setting. It; was not possible to answer this question in any su^?stantive fashion. 

, Most c)? the 'quest iorts concerning the avaUabUity pf space, equipmeiit, and support 
^'rvices of various kinds, and the lead times required, *could not be answered very well, 
and those that could be were 'aSlswered only in terms pf the kpid's of; space and 



equipment beiftg'used in the current course. From the documentation the brief visit 
of thQ research team*, ^mqst .no information was obtained on the kinds of equipment^ > 
space, and suppc^i;, services that, might be available to the Schooi if they were needed..- ' 

. Likewise, ther questions in the/'Instructional Design and I^agement" section of the^ 
course could be answered only by inferences from the course as currently taugh^T 
inforirfation on the broader framework of policies within which the School operates was' 
not available without*extended immersio.n in USAF and ATC directives and regulations. 
. Finally, the documentation 'provided no information about' the characteristics <)f students 
^ taught in the course,'ana the impressions obtained during the brief visit of the research 
>team' were considered whoUy inadequate as a basis for answering the questions in this 
section of the mod'el. ^ ' . . ' 

It is clear .that this model cannot be applied very successfuUy to a training setting at 
a- distance and with documentation intended for other uses, as in this case. A Wide' 
variety Qf>formation is needed to answer the questions on the training setting side of 
the model. If detailed and specific answers to the questions are sorfght in a secondary 
analysis, as described in the introduction to the model in Chapter 4, information, will 
' probably have to* be obtained "from a variety of sources, including agencies having 
refeponsibUity for. the controller, civU engineering, and personnel management functions, 
as weU as from* knowledgeable {Personnel both at the instructional department level and at 
higher command levels. ' , * ' ' - 

. Questions concerning the avaUabUity of fu^ds in this training setting.could not be 
answered for two reasoae-the lack of information, an*d the fact that these question's 
involved consideratfon of a' specific gaining approach.^ Questions concerning the avalla- ' 
bUity of space „and equipment also involve^o some extent the training approach being 
donsidered. 'Applying tM model to a training ^tting-without having a specific training 
aj«)roach under consideration leads to inventorying the. training setting" on several .differ- 
enldimensions that the questions involve: resources, nature of training 'content, personnel 
tboth students and instructors), and general poUcies. WhUe this may be wort;hwhile it is 
hkely to be a demanding task. If a specific training approach is under consideration, the 
scope of the-afIswers,io the questions about the training setting can be markedly reduced, 
so that the .only information sought is , that necessary to evaluate thp training approach 
for possible use in this training setting. ', . ■ • 

-rt was found that the questions concerning the characteristics of the training content 
in this training getting could be answered fairly readily, ^biit' even here a difficulty ' 
developed. Because the training or criterion objectives w6re clearly setf out in the. Plan of 
Instruotion, it appeared paCural arid stfaightforward to use these objectives as the units 
for describing' the kinds of student performances nee'ded in the. training. However, jthere 
fere 106 objectives listed in the Plan of Instruction, and the, effort; to describe the! kind * 
of student performance implied. by each of them degenerated into a tedious and 
repetitive analysis. Dividing- the training content into somevyhat fewer and Jarger units 
would probably' lead to a ipore satisfactory analysis. - " - . 

. This application of the nfodel to -ajji^ining setting contributed information on- which 
a number of chs|nges in the model were b^ed. These changes, mainly in the section on 
"qharacteristtcs of gaining, Cpntentj'V.we^e of two kinds: (a) changes to bring some 
questions more' closely in -line with^J^ir Training Commandi^noVienclature, so that the 

model-yil^-t^e'?^-'"- *— ■ ,.-,s ^ . .^^^f. . 

to use; and (b) 





to aid ill ^'^nswering the questions. These changes have been made in the cujrent version 
^of the mddel, as it is presented in this report. * i ./ 

this appUc.atipn of the model to alining setting was not very satisfactory fit 

is.-not'mese^^ 4.^ ^ /'/ * . 

If In V cOTtiniiation of ,thiB work,^ it is planned to a^ply the mo^el tjO a training 

setting (a&ia^il as to a training approach) in close coll^borati^on with Air Force personnel 
,in a Technical Training , Center. In^ this application it should ^ be possible to obtain the 

information that was lacking in the application described above, and the^applicatiqn will 

also involve a specific training approach. Therefore, thorough and rigorous evaluation of 

the model should be.possible. ^ 
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tJESENT STATUS OF MobET" 
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?e model; for matching fejhing approaches with traitiing settings 'present^ earlier ' 
report fe^ a second generation- model.- After its" initial 4V?lot>me&^, U was: taken-to • , 

at Air Force Technical Tiaihing G^ters where it TYa^';ejit)osed^<;6* j|e .criticism of- 
.^'^^ ^'^^^^^S mana^ and^ deSigri^rs for whose.^j^-It, wjis'^i^trucfed. This 
criticism sQpported .the^^genera^iagprpacH -of using two coo^ated sefe-'of'-qiiestibns, one 
mg with- the trainmg approach and- one mih the training setting,- &nd ^he 'iuii(is' of 
qud^ions that had been inqliflJed jn theixinginat version of the model.- Many additional- 
quesfi^ons were .suggested aridhife been induded'in'the current, version of the mddel/and 
the primary tiurust-of the inoael: has; been shifted to- guestions- dealing wi^ training costs 
and resourcesi>f=^ '. - f h , , ^^-'N . ''•-^ " . ■ : . 

The cunomTVersio^ of' thT^iiid^il- h^ been applied;:^' a training approach and to a- ' - * 
framing «'Settii!g:.;£a^^PElicatioiCt<ilthe' p was quite 

successful, b3^;^iS^a1apn4<?:tfr^tii^g T^^^^ Lk^JEnforcement Specialist • '" 

couise at Laciag_Ag- Force ^ase-jj^.-.rj&iuch lfiss-so-primarily .t^use the documenta- / 
bon and qthec^^j^ation aVailableVys^^.^dequat6'for answering mahy ofthe questions / / W 
on the trainin^fife-ttj^||,side-bf ;thQ>=im>del.- This difhculty can "almost certainly b^J /^'' 
overcome by worlc^Tmofe, closely witif -Air 'Force training_managers, and designers in the- ' / i 
training setting. ' " *^~v-. " \ • v-* - i! ' 

^During these appSfbris:_of the. inoddjto both fee training approaCh jand .th%^ 
traimng^etting, it became apparent that a ffew^questions cqrlceming the training approach J ' 
could notx^ ansTSfored adequately without infdfiriation on a specific training setting, and 
,^ that several>[uestions concerning^ the training' setting could not be answered very well 
y.-^jS. unless one wasXconsidering specific training apjjroach for use in that training setting. 
.[^is partial interdependence' d| the trainirig approach and training setting sides- of flife-' 
iSlpdel is of no conseciuence if it is being used to evaluate ^ training" approach in relatio^' " 
requirements df^^a trait^ setting. It may create some problems if theomo^erfs 
to describe^ a traitojg approach, or to inventory the Characteristics (and 
a training setting, mwependently. Whether .the model should be revi/ed',Vo 
ig. approach and:;M^ining settmg parts maj^ be used fully, eactf'di^e-. 
if the other, -or wheth^ this interdependence* is. desirable, depend? 'dn lh^ 
plications for which/the liiodel is found%) be^ most .useful. Further expraie^ce. 
is necessary to resolve this question. ' \ * ' ''14. 
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Technical Training Center.' The peer instruction system (to Which the model was applied 
m. , Chapter 6) emei^ed as a training^ approach that appeared suitable for a demonstratipn 
implementation in an Air Force technical training setting**- and the research team also^ 
f^und at i\ir Force Technical Training Centers^ that the tmning managers and. designers 
showed interest in that approach. To ^utilize tliis int^ce^, and at the same thne subject 
the model to a^^gorous empirical evaluation ih-sair^perationai training situation, it is^ 
planned tp use tlje model in the selection ota particular courseMn which to implement 
the peer instructi(^n training approach. ' . - ( • ; ^ 

The application of the model ^to the^trainiffg settings associated with the (Candidate 
courses wiir be carried out in close^coopera^wn with trauiing managers and designers who 
*are working? in these training settings. ThMs^ the infqrmation that wa^ lacking in the. 
application of the model to* a training setting described in Chapter 6 should^ be readily 
available. Furthermore, these appHcations of the model to training setting will be carried 
out in relation to tiie peer instruction training approach, so that it should be possible to 
answer all questions on the training setting side of^.the model. These applications of the 
model to the peer instruction training approach and to a nunaber of training settings will 
make possible a rigorous evaluation of the tisefu&iess of the model for matching training 
approaches with training settings. • 

Jt is also planned to use the model on a micro-level to analyze in detail the segments 
or modules into which the selected course will tie divided. The purpose of these analyses 
is to select the specific adaptation of the peer instruction training approach to be used in 
each module of the course, and to anticipate problems in the development and imple- 
mentation of the modules of the course. Thus, the use of the model as a general-purpose 
analytical tool in developing and implementing training approaches in particular training 
settings will be explored and evaluated. , * 



FUTURE POSSIBILITIES,, / ' 

The approach taken in constructing this model offers the possibility of a stand- 
ardized method of describing and evaluating training approaches in Iferms that are clearly 
relevant to the^ realities of training settings. The method would be comprehensive, and 
reflect the day-to-day, down-to-earth concerns of training managers and desi^^ "Working 
in military training settings. ^ When training approaches selecied^ By this^Plthod are 
implemented, they should be considerably more likely to • R^odCTce desirable,^ hoped-for 
results than training approaches selected by current methods t|iat are less systematic 
and comprehensive. <:>^ ^ < 

A Center for Evaluating'Tralning Approach^ c v . 

Ta make .this standardized method for describing .and evaluating' training approaches 
available to^military^^ining managers and^ designer?, a Center for Evaluating Training 
Approaches is proposed. ThjS' function^ of. this information center would be to: < 
(1) Analyze training approaches by applying the model to them. 
^ (2) Make available in standardized^ fonpats the results of these analyses of 
. training approaches. \ 



. , / * Under a continuation of U.S. Air F^rce Ofrice^,of Scientific Rese^h Contract No..F4462Q-74-C: 
QOOT,' Bailc Research Relevant to U.S. Air Force Technical Training: explication and Evaluation of £t 
Model for Mat^ching Training Approaches with Trainings Settings it^ cm Actual Instructional Situation. 



* ^Training managers and designers would apply the training setting side of the model 
to thdr training setting. Thus, the intimate knowledge c of their bwn training setting 
• '^poss^'ed'by twining managers and designers would be tapped by this procedure. 

l^e resitlfe of the analyses of many training approaches by the Center staff could be 
made, Available in a number of ways. One method would he to publish a coUection of 
standairdized descriptions of training approaches, 'which training managers and designers 
- could con^t affer they had-analyzed their training settifig to select onfe^or more training 
ap|m)dphes that>matchea tljwt^t^ hetting partic^brly Well. Anothek method wouU 
. be Construct a computerizedVdata bkk of trajriing Approach descriptions and have 
tracing managers and designers^ send the analyse^^of their training settings^ the center 
.so that a com|)rehensive compiyterized matching/procedure pould be carried out. 

Such a :^stem would facilitate - the selection of training approaches \or Course 
developpient oKrevisjon^efforts by making ^ssible quick searches covering la^e^umbers 
of cancjidate trainifig approaches. Becaus^the model to be used in this selectioji process 
^is explicitly o.^^ed around factors j6l major importance in real-life notary training 
' settings,! the ^^^^^^^^^s should be hirfily valid. Thus, the training approaches selecle<^by 
these method? should have substantiany impro(^ed chances for successful implementation. 
Currency usecJ procedure's lor selecting training approaches for implementation somSimes. 
suffer firom faddism, or bandw^on effects, and a' system based on this model would 
avoid o^reduce this problem.*/ 

When a ^training' apprp^cfi selected by, these methods has been implemented in < 
training ^setting, informa^bn on the success of .the implementation and any difficulties 
. encountered should be fed back tojhe Center for Evaluating Training Apprq^ches. Thus, 
the effectiveness of /flie selection process and ^;he adequacy of the model can bi 
continu^y evalyated^ ' ■ ' 

If innovative/draining approache^s are analyzed and entered into sucl? a system as 
soon as they have been dieveloped and given preliminary evaluations in one training 
setting^hey ^mdd be immediately available for consideration and evaluation in many 
other tfainij^g settings. The increased validity of the process by which these innovative 
traJhmgi|pproach^ would thedbe selected for implementation in other training settings 
wduld n|^e the process of tec»nology*trahster and utilization more efficient, by reducing- 
the nui^er of inappropriate, efforts to implement innovative training approaches that 
would ^ likely to result in failure. Thiis, the overall effect of this system would be> 
/ improv^ utilization of research on trying methods and approacbesr- , 
/ P^^* studies 'under Air Force ^uspices,^th^enter for Evaluating Training 

-Approaches should probably be set^ at the Departm^t pf Defense level, so that the 
whole rmge of military training approaches anid -settings to'^which the model and the 
^system ^^buld be applicable could be inclutea. Thus, the utilization of training research.^ 
through^t the military services wt)uld be improved. 

A Civilian Analogue ^ ,^ / . 

The^ civilian educational system' in the United States is in great need of a system for 
prdvidin| better guidanc^ for, and oi)teining better utilization of, the substantial volume 
of educ^ional research and development that h^:'been done in recent years (Comptroller 
<3en^ralW the U.S., 1973; Gideonse, 1971). A civilian analogue of the Center for 
,/^EvalUatij|g Training Approaches just*described could <;ontribute to satisfying this need. 
. The moi^el would need to be revised' to orientit around factors of major importance 
in civilian educational settings, instead of those; iniportant in military tmining settings. A 
center. usin| this revised model could^th.en provide educational planners and adminis- 
trators TOth a Capability to rapidly sur^fey^and' select educational approaches that match 
the fequfrements of their educational settings. . ^ 
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Appendix 



AP>LICATION OF MODEL TO 
XP€ER INS^TRUCTION TRAINING APPROACH 



^This application of the model fot matching training approaches with traming settings- ^ 
^as made to the peer instruction training approach (Weingarten,.^t a/., 1973), considere3" 
independently of any particular training setting, in»an effort to determine whether'the 
questions on the training apgroach side of tHe model .oould<<^ answ,<ered with reasonable 
facility tor a relatively qpmplek and -comprehensive^ training approach. The application 
was ^made by the project principal investigator*, who constructed the model, in japproxi- 
mateiy. nine hours.' , ? ^ ' , 

.Thq peer instruction training approach, in ti^ case included, both the pee,r instruc- 
^tion anfd the ttiastery testing trsdning appro^ches,''as described in Chapter 2[of this report, 
since operational pepr instriictioh systems have included both features. • > 

This application^of the model to '±he peer instructibn training approach was 
considered successful, and is discussed in Chapter 6 of this report, - 



, 4 

Training Approach 



OBJECTIVES . \ 

What IS thfe ge.oer^l nature of the evidence that indicates that this * 
training approach might improve the performance of the training 
system or solve the problennf affecting it? (Answers to later questions in , ' ^ ' s : \ 
this modeLwill* explore this in nnore detail.) The following list describes ' • — 4 

some benefits that might be^ gained by adopting a new* training 
approach: » 

Redu& student attrition * • ' 

Improve job perforTOnce of graduates • 

Savetrair^jngctiiTje * ^ ; ' * . 

• Reduce training costs « » • * ^ 

• Adapt course to students of lower (or , higher) aptitude than * »<. , 
previously 



A pilot test of the peer instruction system in the Artfiy Field Wireman toorse Fort Oixl (Weingarten, 

etjL, 7 972)' yielded substantial increased in the proficiency of graduates over 0je conventional course, 

ranging from 24% to 74% on various parts of ihe course. Attrition faf.4c^emia reasons was reduced 

from 19%' in the conventional course \o 12.5% in the peer instruction cour^, and the^perckniage of^^ 

students who were recycled through parts, the' course was reduced fromJSO^ toO%, 

* » ?^'> . > • , 

In ^ course graduating ZOOO field wiremen^per year, the timi save^My these reductions in attrition. 

and recycling (time^speM in course by students who do not graduate, and extra'time spent in cpurse 
because of recycling) amounted to 26^40 man-days per yean At an estimated cost of $30 per 
map-pay of training, the savings amounted^ to ^08,200. When additional costs for equipment of 
$21fiOQ are sub^tracted frpm this figure, the net saving was approximately $262 for^^ch graduate. 

Additional savings in time and cost^ would have been possible from self-pacing the course and allowing 
students who could finish early to do so, except for statutory requirements^ for a hinimum amount of 
training before soldiers. could be sent oversea:^ Further, the peer instruction system was succes^ul in 
accommodating ^students with a wide ranges of aptitude levels and backgrounds and, based on ' 
anecdd^l eyjdence, appeared to have substantia/ positive effects on student motivation.' The peer 
instruct/on system has been implemented in at least 12 other Army courses in the three years sirtpe the 
original pilot test at Fort Ord. ' i , * '* 



RESOURCES REQUIRED 



A, implications of training approach for costs. ]^ 

\ ' . s *• ' ' * ^V" 

1. What capital expenditures will be necessary if this train-," . ' " ' . - 

ing approach is implemented? Examples of capit^!^ ^ < > . 

•v^ expenditures-new or remodeled facilities/ or equip- - ' ' ^ ^ 

merft purchases. # ^ * 

/. Some additional equipment will, probably be necessary to implement the peerJnstruc- . ' ^ 
tion method. 
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^ ^ ... ^ 

2. What kinds^ a,nd amounts of operating^expenses yyjil be 

invoWed 'if this training approWh ii4iT<plemHBnted? Areas 
/ in which operating expenses may* be important include i 

~ personnel, physical facilities, and instructional matenaljr^ 

if . - 

2, Additional materials may be needed, to provide the hands-on performance training the 
method stresses. v.^ ' . • 

3. If this training approach es implemented, what kinds and 
amounts 'of training development cgsts will be incurred? 

.Both initial training analysis and development costs (job ,^ • • . - ^ 

analysis, training content analysis, development of^the 
instructional^ system, and .development of the training ' • 
materials) and the cq;st involved in repeating these 
analysis and development ^eps when^ the trainfng con- • ~ , . 

tent is changed, should be considered » * * ' * ^ t 

3: Unless the ^course is already performance^ oriented, sUb^stantiai work onideveloping 
outlines of the sffecific performances to be required of students will be necessary. 
• ^ Performance tests rnast a'lso'^be developed that embody these performances. 

4. When all costs of implementing this training approach - ^ 

are ofnsidered and thes^ costs are distributed over the " 

nurpber of students likely to be trained, how does the , * 

cost per student compare with that of alternative train-. * . » . 

log approaches? » \ * 

• -» * ' 

4. Data, needed from a specific training setting. 

5. Will this training approach permit the sharing of 
expensive facilities or equipment with other courses, or 
with operational u5es? ^ * 

-5. Possibly, but information needed from a^ecific training setting, 

6. Will implementation of this* 'training approach result in 
some equipment no longer being rjecessary? * * 

\ 6. Possibly* but info/cation needed from a specific trainmg setting. 



Materiel and facilities requiremenu for this train- 
ing approach, [ . ^ ^ ' ^ 

1. For* what kinds bf ^training locations or situations is this 
training approach suitable? Examples are showru irt' the 
folFowing list" (additional kinds of locations or situations 
should be cpntftijered if appropriate): * 

• Formal school training, of a continuing nature 

• Special school training, of a one«time nature 

• Basic military, training 

• On-the-job training \ , * 
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• Field training^^ 
Learmng resource center " 
Dispersed* locations 

' Remote sites ' ' 



/, peer instruction me^od is suitable for formal sphool training, and fot basic 
- military training, if operational Equipment we'r^ used, the method couid be adapted for 
use at dispersed iocations and remote sit^: 
* • ^ 
Space requirements. - ^ * - * * 

a.^ What kinds of space ^'re^ needed to use this trairting .?. 
approach^ with the training content W^ng 



sidered? Examples ol^kinds of space:. 



con^*' 



Classroom 
Laboratory 

Practical exercise facilities- 
Outdoor ranges or nnaneuver areas 
Storage 



Kinds of space needed depend pn fcinds of performance activities required of 
' students. ^ . , /Cj 



What anrx)uhts of the various kindsoJ<^ce are 
needed (at least in relative terms)/^^a^mparlng 
training approaches? ^ ^ 




b. 



• May . need ^ore space than conyeationai traininj^ to provide for student per- 
"^rmance activities. \> , • 



>c. 



What elements m-the training approach or method 
are related to space needs? Examples: ' . 

• One classroom for each class of students. 

• One terminal , for each student using the system. 

• ' One le^frning s^tion for each module of content 



One or more ieaming stations, wi^ equipment, for each segment or mdduie of 
course. . ' - * - - ^ 



d. Does the training approacli require tfiat'the space to'^ 
* be used have special utilities or characteristics? 

Examples: * . ' ' * ' 

Ejectric power requirerhents -v. ^ • 

• Air condFtion^ng and ventilation regulrements^ " ^ , . 
Lighting requirements , \ ^ ♦ /&? 

• Floor loading capacity * - . f ^ 

- • i- » ■ ' - ' . - \ ^/^ 

{/. Depends on performance and equipment requirements, 

* '\ ' , * 

e. Are environmental extremes (heat, cpld, humidity^,^ 
etc) ^ntportant considerations irf using ,this train- 
ing a pproach?^ ' ' ' 

e. depends on performahqe ^uirements of training content 

What kinds of .equipment and nriateriel are required to 
use ^,this training approach with the trajning content, 

being j:enside'red? The following list suggests kinds of • ;K ^ ^ 

equipment and materiel that may be needed (additional ■ " ^ ^ , ^ 

types of equipment- and materiel should be listed i • v, 

if needed): . • ? ' " . 

Operational equipment v 

r^onoperatipnal equipment - \ ' / 

A^dlovi^al ^uipment 
Films, audio and video cassettes- 
^l^irt-task training.^vices 
Uow-fidelity simulatqrs 
Larg^,, high-fidelity sinHflators 
Training .aids '(charts,"\(ransparencies, cut-away^ 
equipment; etc.) 

Study guides," Technical Orde^;<;oi' othef ^p^nted 
trarnjng material \ • j^-. ^ 

^Uob performance aids * . * r 

3. Equipment is required for performance-orientea^training: the kinds of equipment 
depend oh the kinds of performance invblved. Minirhai guidelines for the' performance 
tasks are also required. , r, * 

Instructional equipment and materials mianagement. 

a. If this training approach is implemented,^; and ' ^ 
equipment of any complexity is to be used in the 

training, does Jhe projected utilization schedule for^ - ' * 

the equipnjent provide time for maintenance? . ^ 



depends ort specific plans in a particular training setting. 
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, b. Is this training approach compatible with the use of 
itram'ing materials with a security clasjification? 

- I'^A Yes, - , f « ; 

c!; ppes this training approach require the use of copy* ^ * ^ 

* righted materials? ? ' ' 

. c. ft may, in some cases, \ . 

d. In planning for the implementation of this training . * ' ^ ' 
approach, have allowances been made fo^f the lead 

time necessary to obtain any needed equipment? 

d. Depends 'on specific plans in a particular training setting, 

e. v^boes^lhis training approach^uire base support for 

printing,^ or ?f($r the preparation of slides, audio or * • / * ^ 

* Y^eo^^^apes, or other audiovisual materials? If so, ^ 

has provision been made in planffed schedules for s 
s i the .lead times involved? ^ 

^ ^ff. It rmy: details depend on specif ifplans in a parti(*ular training setting. , 

i; C. Instructor^ requjfements for this training approach. (See - - 

section pn Instructional Personnel) * 

,1 ' . / " - . '\ ; 

* C. Instructor requirements; for ^tfjfs tralhing approath (see section on Instructional Personnel) 



INSTRUCTIONAL DESIGN ANb.MANAGEMENT 

J^^^MtrnAi^H^tteWA imKliMti^^n*^ fQ|r WhOthOr 



A, ^« thi^;ti|lnin|^ii^^ 

the; ln$tr}ictWiJ^ jaced or indivic 



ndividually paced? 
a'lfkimBar of kinds of instruc* 



r 



The foHowing list (j(bjdfj[| 
S"*tioiial design: * : I^J 

. • Group/lock ■'s;tf|>j.^;Studems receive instruction in groups 
. , and all members^bf a group, progress at a scheduled rate. . 
> Group pacing: Students progress through the instruction 
at a. rate determined by th€[ abilities of th^ group as a 
whole. Gro(ip ,of homogeneous ability levels may be 
formed (multiple tracks). , . 

Diagnostic ''proficiency individualization (modular 
scheduling): Students are tested to determine whether 
, . they.nieed to stud^' sections of the y-aining content and 
may ski|^ any training content that their test. 
perfon;nanc8, shows they have*mastered. • • - . * 
..Remedial individualization: -Students can^udy extra 
training material designed to help^ them 'make up for 
« deficiencies in their prejia^tiorl. 
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' SuppliefTientary individualization: Students ^re allowed 
to work on nwre thanfone block of a course at one 
' time. This^may include ouuide study assig*nnf)ents. 

• Rate , indiv.idualizatioh (self -pacing): Students may 
' proceed at their own pace, through 'the required train- 
^ ing materials. 

• • Alternative methods or media indivldualizatton (muf^i- 

niediJi, instruction): Students have a choice (at least part 
of^the time) as to the methods or media they use, in 
• studying ttie training content. 



The method k basically self-paced, but it can be adapted to group/lock step schedules by 
the use of buffer periods when students pe^rm various administrative functions in the 
system. Diagnostic proficiency individufiization (modular scheduling), and remedial 
individualization is informally intorporated ih ttie peerinstructioij process, as,nec(ded. 



B, ^ Does this trslnlng^ approach Indicate that a fixed/ita.ndard , , 

level of skill or proficiency is expected of graduates of the ^ » 
instruction/ or that each student is expected to develop his 
capabilities as far as he can, and in areas at least partly i 
determined by- his own ^ntefrests? * u 

B] The, method has so far been used' only with a fixed, st^da^d level of^skillorproficiency 
^ required. • . . ' ^ ^ 

^ ' ' 

C. ^ E)oes this training approach make fjrovtsion for, or have any ^ / 

^implications for the proifisipn of management information? • ' ^ 

The/ following list \ndicates, some of the kinds of manage- V. ^ . 

ment information that might'^be.involved: ,f . ^ 

• Information on students' backgrounds 

• rnformatibn on students' .progress^ through the- course 
- of instruction : , ^ , t ^ 

• Informa'tion on the adequacy of various parts- of the ^ , , 
0 " V course of trainfhg • » - ' ^ ' 

' Information on the adequacy of graduates' performance 

• Inforinatlon on fnstructional resource utilization- ' - 



G Information on students* progress through the course of ipstructiorr anfi on the adequacy 
of the training provided by each peer instru(:tor fs amiable frbni she normal operation of 
, ' the peer instruction !sy stem. : s * 

CHARACTERISTICS 6lF TRAINING CONTENT ; c . ^ ? ^ 

A.' Is this training approach suitable for the of student ^ 

' performances that pan accomplish the training objectives? ^ ' . 
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foll9wing lirt of kir^ of student performances can be. 
considered whc(n evaru^trig whether this training approach es ^ 
suitable (any additional' types or terms needed tb describe, 
the kinds of performances specified, by the training 
objectives should be oi^ also): . [ ' 

• Recall and application of facts / 

Remembering the terminology of an equipment 
system and the rtarjnes and locations of the controls 
so that^h'e student can speak or write with reason- 
/ able fluenpy concerning the system i 
' ^ Making specific control settings u 

* " &rial procedures ' . 
^ Fixed ' ' 

Energizing:^lectronic equipment 
Crew drill/ffi a weapons system 
Variable, or branchingr 

TroublesfTi'^t^ng,*(»mprex equipment u^ng pro- 
ceduralizea^nnfethods and job aids , 
Emergei^;. prt^d^u res,- which* ofteri Involve 
branching; aw^y^^Uor^^ \btherwise \fj;ied pro- 
enures V* *\ r= 

. Tracking afnd aiming = "^-{J ^ *- / V: * 
Rai^ar tracking v- r .^A^ ^ \ 

Aiming a gurf \[ " - . ^ 

Searching and scanning* t \'( \/* ^ • ' 

Aircraft detection 
#• Aerial observation 



/ 



Scanning-quick searc^, .sutJprdin^teVfpVsome ot 



task, such 
driving. 



as 



scanning Wnstrumenf;' panel whi 



Discrete or continuous perforrr^nce! * ^ - 



mVu^ ^'screte-step-by-step per^ol-m^^ce, with individuaP 
\ steps being clearly separat^' element^tof the per- 
formance , >^ ^ - ' 
, \ L\\ Operating control panels iVtprssiW.systems 
••• Assembly and disassembly;§f equjpmerit 
• \^\^"^'""^"^~*^""^ ^ divid^ 'lhto\clearly ^epar^e 
\\**..^lemehts; continuing perforn^nolj [dsuallV ^uj^ 

;i v*:|^modVlatedb/f^bacl^^^ V ; ^« 

\ \*ff Aligning or adjOking electrbVp'ef^Mip^nent^ ; 
^ \*i*vRiding a bicycle J- 
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Skilled^ actions-activities that the untrained person 
cannot perform satisfactorily, even if he is told what to 
do ^ 

Clutching and shifting an autonK)bile with a manual 

transmission ^ . ' ^ ; 

Precision measurement with a micrometer ^ • ^ » 

Discrimination behavior-recognizing differences between ^ ^ ; \ * ' 

objects, indications, or examples so that different : * 
responses can be made to them . i " 

Aircraft, tank, or automobile identificfation J : ^ 

Selecting one answer, example or object (solder • ^ " ' - *. 
joint, for example) as .the "best" or "correct" one, 

according to certain standards. ' ^ • \ 

• Complex perceptual-motor behavior , f / 

Driving a car - * ; 

. Flying an airplane 

• Problem-solving-recall and application of concepts and 
principles ^ , * 

Troqbleshooting complex equipment without pro- 

7c6diJrali2ed ?nethods and job aids ' ; • / ^ 

' PJanning . the work of a group of /people and ^v^, 8 - 

assigning tasks ^ V .* 

\ . r-^ » .'-^ 

A, The peer instruction^meihod can be used for any kind.pf training cor^^nt, if the 

performances required of^&re^udent can Me specified, and tests (qan be constructed': to 

measure those performances, 

^ * t ^ - T 

is this training approach suitable, considering the degree of pro- . » ' 
ficiency r^equired in the various tasks or performances ^hat the . 1 ' y ) 
student will be expected no 'a^mplish to satisfy the < training * 
objectives? The follbwing outHne describes the kinds aiKi levels of . 
^oficiency that might required : * . • • ^ 

• ■ Task performance standard|f ' ^ ' . . i ' 

Extremely limited-can do pimple parts of^^the tasks but 'T * 

needs to be told (Sr shown how to do most of the task ' . \; 
Partially proficient-can do most parts of thfe. tasks but 
needs help on the hardest parts pf the tasks \i 
Competent-can do all. parts of the tasks and Weecd^only 
be spot-checked ^» ' * . 

Highly ' proficient-can ^ do complete tasks quickly and 
accurately'-'and Cf n tell or sho^ others how to do the tasks , . "* ' ' 

Task knowledge stahdar<J4/^^/\ / \ ' \; ; * ' ^ f. 

Nomenclature onl/-?ca^ri *,hamA parts, tools,:, and simple ^ .T 

fart^ about the tasks^ . / A'^ * -j^ - ^ * \ ■ I 

^ — Procedures-can n^me the stejDsln doing the'tasks and tell ; ] j j. • 

".how each isc^o"®^^ * ' .y -v - . ► " * r ! 

li 
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— operating principles-can explain why- and when tasks 
, must be done and Why each step of a task- is needed 
Complete- theory-can predict, identify, and resolve 
prot^jems about the tasks ^ , , . 

General knowleclge standards j 

Fafcts-can;cite basic facts about the subject 
PrWiples-can explain relationships among basic facts and 
state general principles about the subject 
••" Analysis-can analyze facts and principles and draw 
conclusions'-about the subject ' * * 
Evaluation-can evaluate Conditions and make 



I 



.decisions aboiit the subject 



proper 



The method can t^e adapted to any level of proficiency required of the student^^ py setting 
Citable standards on the proficiency tests. \V.'- - 



C. 



ImplLcations (or ;re<|uireiT)em5T of training approach for 
ocgantzation of training content.. 



ft. 



1. 



*D6es this training approach provide a basis for dividing 
th(B training content into blocks or modules? 



2. 



The^ peer instruction rpeihod, per se, pro\^ides no basis for dividing the training dqntent 
into blocHs or modules. ^This is usually done on the basis of "naturar divisiops df'the 
training content arid the availability and arrangement of space- apd equipmen\''ih ihe 
training setting, , t - * 1 ' *^ ^ ' 

.5^ 



Does the traiolng approach Have any frT^plicatidns for the 
^^equencinig oi training content?* 



2. 



The ^r 
content 



instruction* method t)as no implications for the sequencing^ if twining 



^ What kinds of instructional activities are implied by 



( 




training approach? The following list gives several examples 
of .kinch of jlnstrudtional ac^vrtj^^ (otf\ers should be added^if 
they are needed):' - *^ 

• Presentation of knowfedge . V . . 

• Practice of knowledge 

• ^Practice of performance j * 
.• Demonstration . . 

• Provision of feedback,: or knowledge of rescilts; 
to students ' 

• Provision of individual, tutorial assistance\to students * 

• Evaluation, or training quality control . . 



D. The peer instrucdon method involves demonstration; practical of kriowledi 
formance; provision of feedback' and individual; tutorial assistant^ ^ti stiiden 
training quality control. ; ; ' * I I 





s 



Training Approach 



What effect does thi$ training approach have, on the effort ' ^ / i 

necessary *to make changes in the training content? In 
answering this question it may be useful to consider the 
kinds of units or modules of content involved in this training 
approach, and the formats or nr>edia to be used. 

£. Changes in the training content can be made very easily with the peer instructfori)n!Bthod. ^ 
New equipment, or other changes, is inserted into the training by having the instrtktors 
teach a few students the changed content, those students then teaching other students, and 
so forth. 



INSTRUCTIONAL PERSONNEL 



What roles do instructors play in this training approach? The 
following list describes some po^ble roles for instructors; 
others should be added if necessary; . 
f Presentation of instruction (lecturing, demonstrating) 

• Evaluation of student performance (pppficiency testing) 

• Monitoring student performance (and intervening when 
K necessary) 

i\}/!anaging the instructional system (assigning students to 
training activities, monitoring training equipment utiliza- 
tion, etc.) 

^anning.and developing instruction (ISO activities) 

• Conducting dispussions 

• Lekding student activities ^ 



A. in ^e peer instruction method, instr'ijctors (the staff of the training institution, not the 
peefiins^)et0rs) evaluate student peffgrmance and manage the instructionahsykem. Some 
' of them may^an and develop instruction^ ^; \ \ 



B. Are auxiliary instriictionat^ personn^ needed with this train- 
' 1 ing appr^ch? The following list describes some possible 
kinds of auxiliary Instructional personnel; other kinds jhould 
be added if needed: 

Proctors (monitoring student activities but not 
intervening) 

AdrpinistratiVfi clerks (recording and processing data) 
Training equipiVi^t operators and repairmen 
Computer programmers 



B, Probably not, although it^^epends on the kinds of equipment used by students and their 
r . • peer instructors. \ ' . 
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What special skills are needed by instructors using this train- 
ir\g approach? ^The following list describes some possible 
kinds of special: skills that might be required; other kinds 
ihould be added if needed: 

• Proficiency in the subject matter students are to learn 

• Managing instructor-student ' relationships (classroom 
management skills, reinforcement techniques, counselling 
techniques, etc.) 

Analyzing and critiquing student performance \ 
Relevant field experience 

Proficiency in instructional system development 
activities 

Operation of audio visual equipment 
Computer operation or programming 
Writing skills 

Proficiency in evaluating student performance 
Knowledge^of the relevant administrative system ^ 
Operation and/or maintenance of operational equipment 



C. 



instructors in the peer instruct/on system should be proficient in- the subject matter 
^ ' students are to learn and in evaluating student performance. Proficiency in instructional 
, system development activities will be necessary for some of the instructors, since it is 
desirable that those who develop the instruction, go on and run the system. ' Field 
experience and knowledge of the relevabt^administrative system would usually be helpful. 

D. Instructional personnel management. 

1. Considering the relevant Trained Personnel Requirement 

(TPR) and the skills of the Instructors available, will this ' [ 
training approach' f'equire more or fewer instructors than J - 

wouW othePA^ise be needed? Does this training approach\ \ / ' 

require some minimum number of instructors to ^ • 

be feasible? \ * 

; 

/. Peer instruction will require np more instructors than wotrd^o'^er^/ise be needed, and 
probably will require^ somewhat fewer, if the number of ^dents% relatively large. A 

. minimum number of instructors is needed; depending on the number of modules or 
learning stations used in the system. * . \ 

^ 2.^ If the number of students is increased or decreased 
substantially, will additional' or fewer instructors be 
r^ufred for this training approach? If so, in what ratio 
to the increased of decreased number of students? ^ 

2. OQ^thei modules or learning stations are sfyffed^^the system, can accomm^ate 
p£on§fd^fy increase!/ humbers of students with Uttfe on no increas^iin numbfiTof 
' itistruc^rs^plicate sets of equipment (learning statics) may be added as necess^i 
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to accommodate large increases in the punier of students, and the number of 
instructors needed will increase when this is done. \ 

Ifnadditional instructors will be needed for implementing 

this training approach, have allowances been^^de In ^jjp^ \ 

planning for .the lead time, necessar^^ to obtain ^ 
these instructors? " ' ' i ^ 

3. Depends on specific plans in a particular training setting. ' S - 

Is special 6r additional training required for instructors * 
to use this training apprpach? The^ resistance to change \> 
found in almost all organizations may be a spedal 
pro)3iem in implementing a new training approach. 

4. The main special paining that is likely to be needed for instructors in a peer 
instruction system is a thorough orientation to their role of managers and quality 
cdntrollers of the training system. This role will be sharply different from that of 
instructors in most other training systems. An excellent way to provide this orientation 
is to have the instructors participate as much as possible in the development and 
preliminary tryouts of die system. 

Do^s this training approach have any special implications 

4ov ' evaluatii^g instructors? Ar^ some^lfistructor per- 
"Tformances is^ntculafly^cntical^in^ls training approad)? 

,Are indicators, of instructor perforh^ance available 'with 
f this training approach? . 

5. The most important funqtion] of ii^tntctors in a peer instruction system is^diat^f 
training quality control (i.e„ ' adrxfinistering and scoring the proficiency tests),. 
Accordingly, this function should be gh^ special might in evaluating insi-uctor^: 
Indicators of instructor performance are nohimmediately available ih tt)e peer instruc- 
tion sy^em aslt has be^ used In' the past. 



STUDENT CHARACTERISTICS 

A. Numbers of students. » 

U Is this training approach feasible for the numbers of 
students that ,must Be^ trained? Do6s this training 
approach require a miriirnum .number^bf students to 
' feasible? , . T - ^ - , ^' ^ 

* Peer instruction requires a miniipuni number^ of students, wbich is the number needed 
^ to keep the Earning stations ^ Or modules <v>erating.' Larger numbers of students can 
>u easily be trained byduplicating the equipment of^ various leapiing stations or^rhodule^ 
as nee^^d^J ^ * * 
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2. Does this'training approach deal with students in groups, 

or can it accommodate a more or less continual flow of r J' 

students Into the training cour^? , ~ • . ' 

2. Peer instruction works best with a more^r-iess ei^and contiouous f/ow of stude/jt^ ' 
" entering training. * . 

3. Can this training approach handle mar^<e3""t1(jctuations in • " 'Cv"" 
the ndTWiirs of students entering training^? ^ J.""' 

3. Peer instruction cannot handle marked fluctuations in the numbers of studen^^nterifjg'^ 
training, except through the mechanic of a Job Surrogate, which is a^mstructionalv: 
management center (Hunger/and, et ai„ 1972). ' ^y '' ^ 

4. Does this training approach utilize a basic instructional V ' 
group of relatively fixed size (e.g., classroom, work, or* / \ 
laboratory group), so that there is^ relatively fixed 

Increment by whfch the number of student^ m training 

can be incj;:eased or decreased? ' / / 

4. The peer instruction uses a basic instructional group of two: the peer instructor and 
the student learner Therefore, the /lumber of students can readily be adjusted up or 
down, although sudden increases in the number of students entering training creates^' 
the temporary problem, of too Jew peer instr^Mrs and throws an extra burden'dn:^e , 
regular instructors, ' * ^ 

Relationship of training approach to student aptitude levels. 

1. Is this training approach especially suitable for students 
within a particular range of the relevant aptitudes-high, 
lovv, or middle-or is it useful fon^udents of all apti- 
tude levfeW? ^ . - 

/. 77?^ peer instruction system is useful -for students of all aptitude levels, m)'xed together. 

2. Is this training approach suitable for students selected 

for any special aptitudes othfer than the four standard ^ 
Air Force aptitude areas (Administrative, Electronics, 
' • "General, andc Mechanical)', such as athletic, verbal, cleri- 
cal, pr space relations? 

-f^ ' . . . ; ' . 

2. 777e effectiveness laf the peer instruction system does not depend^on students being 
selected on any kind of aptitude, beyond the capability for elementary communication 
. between the student learner ari(( the peer instructor. 

Special skills or other characteristic required of students by 

this training approach. ' * * , ^ 

1. Does this training approach* assUme that entering stu- • "* . . 

dents wHI already have been trained in any special skills?* ^ . 

No, unless the training content has been developed under the assumption that students 
wiU have had training in some sfiecial skills.] 
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2. Must students have some minimum .reading level for this ^ ^ 
* training approach to be feasible? ' 

2. No, It depeMs on the trBining^ content, but peer Instructors have shown consijdecable 
dpes^rcefutness in teaching v^ious kinds of performance-oriented content 

3. Does this ^^ining approach r^ulre-that students- have 

espeti3lly '^6d vision, hearing, or qther senses? What » ^ • \ ' • 

about stucients with poor sensory acuity, especially 

those who are more or less color-blind? J, ^ 

3. ^ No, unfess the 'performances Involve^n the training content require good sensory ^ 

acuity. - , , . /* ^ ^ ^ . * ' • ^ 

4. Does,, this training approach have any -implications or 

requirements for other student characteristics; such as^ ^ *^ . , 

physicaf stamina, fear of height, volunteer vs. non- ^ * . 

volunteer. Human Reliability, Speech impediments, ^ 
manual dexterity, appearance and bearing, etc.? ^ * * 

4. No, depends on performance requirements of traihing content, 

5. Cah^tos graining approach acfeomnrjodate students whp * * ; 
are iinusgally str6r»g-<or-wealt},-or large (or small)? * 

5: yes. 

Does thUftraming approach have any implications for the sex , 
of ^.students, or for wiiether students are dealt with' in ^ 
sext^ily rmixed or segreg9ted youps? Factors ^that might be V ' 

invqfved^/here indude: - different equipment or., clothing ^ * 
reqtiir9iji:^nt$ forewomen from men, or from those normally ^ ^ - 

used'by 'woniw; latrine fadlrtie$;jql^^ 

D. Nd/^kf7ll[ would depend on the^perfbrm^TCeS required by the. training content, and the 
' ' ,citcuJf)Stances under whKh the^traffjing IMS * * * 

Does tni$.tnitnln9 approadi have anWimplicatfons concerning . ^ > 
wfsether Toresgn students, or students f^om other services are ^ 
involved in the trafriing? ' / . / 

No, the peer Instruction ^system has worked well with students of diverse cultural back' 
gfpu'ods, ihe only .qualification jbeing that pie pedir instructor must be able to communicate 
with his student learner in some language. i\ . * • 



Does this training approach have any provisions for dealing 
. wHh students wfio may be very pborly nrK)tivated because of 
b malassignment or fpr other reasons? ' * • 

p, . ** * , ^ 

r F. Instructors can decide which peer instructoh to assign to student learners according to any 
criteria that are likely to improve student performance. Iniormal observation of operatiortal 
peer instruction systems has yielded numerous examples of stimulating' and constructive 
. peer- mqtructor - student learner relationships ^that appeared to have had dramatic positive 
effects on poorly motivate^ learners. ^ ^^ , ' 

Implications of training approach for student management. \ ' . 

.1.' Will it *make any difference in . using this trailing ' " 

approach whether the course of instruction is»of fixe8 
or variable length for diffS^ent slS3fents? 

J. No, either fixed- or variable length coucses may be taught, using the peer instructic 
system, 

2. If this^ training approach, is used, wiirinformation be 
4 available from which to predict students' dates of avail- 
^""a^ility for assignment (graduation), if a variable length - ' * 

course of instruction is used? ^ ^ ' 

^ 2: The peer instruction System would yield , information on rate of studeryt progress ^during 
the early portion of a course, and a predicted graduation date' based on an extrapola- 
tiorr of the ^rly rate of progress is a reasonable one. For a discussion of this topic^ sep ^ 
. Hunter and Wagner (1973), ^ ' J 

.3. yVill use of this trainfng approach^make it necessary (or ~ 
possible) for students to have^ periods of time before, 
• during, or after the main body of training when, they 
vsdJI not be occupied with training activities? If so, and ^ 
students are not required to perform details or other . ' * 

activities not related to straining, does tnis training' ' 
approach suggest constructive useVfor this time? \ * . 

3. The p^r instruction systemcarr be so-arfinged, and students wfio have finished a 
module of training can assiaFfh the administration of the training system. W . , 

4. Can this training approach accommodate student * ^ ^ : 

• - absences from training activities, and the Resulting need f ' 
to make up miss6d work? * - ' 

4. Student^ ' who have misxd training be afigned to peer instructors -(perhaps 
different ones than they started th^ module yvith) quite flexibly and thus continue 
theimtraining, / - 



